-- Logs begin at Thu 2022-08-04 20:03:25 UTC, end at Thu 2022-08-04 21:41:49 UTC. -- Aug 04 21:03:02.387530 dv-cinder-852209-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 21:03:02.399891 dv-cinder-852209-1-smb devstack@keystone.service[80832]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 21:03:02.403683 dv-cinder-852209-1-smb devstack@keystone.service[80832]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 21:03:02 2022] *** Aug 04 21:03:02.404004 dv-cinder-852209-1-smb devstack@keystone.service[80832]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 21:03:02.404166 dv-cinder-852209-1-smb devstack@keystone.service[80832]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 21:03:02.404283 dv-cinder-852209-1-smb devstack@keystone.service[80832]: nodename: dv-cinder-852209-1-smb Aug 04 21:03:02.404388 dv-cinder-852209-1-smb devstack@keystone.service[80832]: machine: x86_64 Aug 04 21:03:02.404506 dv-cinder-852209-1-smb devstack@keystone.service[80832]: clock source: unix Aug 04 21:03:02.404602 dv-cinder-852209-1-smb devstack@keystone.service[80832]: pcre jit disabled Aug 04 21:03:02.404710 dv-cinder-852209-1-smb devstack@keystone.service[80832]: detected number of CPU cores: 4 Aug 04 21:03:02.404811 dv-cinder-852209-1-smb devstack@keystone.service[80832]: current working directory: / Aug 04 21:03:02.404931 dv-cinder-852209-1-smb devstack@keystone.service[80832]: detected binary path: /usr/bin/uwsgi-core Aug 04 21:03:02.405050 dv-cinder-852209-1-smb devstack@keystone.service[80832]: your processes number limit is 47680 Aug 04 21:03:02.405155 dv-cinder-852209-1-smb devstack@keystone.service[80832]: your memory page size is 4096 bytes Aug 04 21:03:02.405253 dv-cinder-852209-1-smb devstack@keystone.service[80832]: detected max file descriptor number: 2048 Aug 04 21:03:02.405364 dv-cinder-852209-1-smb devstack@keystone.service[80832]: lock engine: pthread robust mutexes Aug 04 21:03:02.405626 dv-cinder-852209-1-smb devstack@keystone.service[80832]: thunder lock: enabled Aug 04 21:03:02.405923 dv-cinder-852209-1-smb devstack@keystone.service[80832]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 21:03:02.406103 dv-cinder-852209-1-smb devstack@keystone.service[80832]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 21:03:02.445958 dv-cinder-852209-1-smb devstack@keystone.service[80832]: Python main interpreter initialized at 0x55dbd9d369c0 Aug 04 21:03:02.445958 dv-cinder-852209-1-smb devstack@keystone.service[80832]: python threads support enabled Aug 04 21:03:02.445958 dv-cinder-852209-1-smb devstack@keystone.service[80832]: your server socket listen backlog is limited to 100 connections Aug 04 21:03:02.445958 dv-cinder-852209-1-smb devstack@keystone.service[80832]: your mercy for graceful operations on workers is 90 seconds Aug 04 21:03:02.446368 dv-cinder-852209-1-smb devstack@keystone.service[80832]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 21:03:02.446444 dv-cinder-852209-1-smb devstack@keystone.service[80832]: *** Operational MODE: preforking *** Aug 04 21:03:02.446674 dv-cinder-852209-1-smb devstack@keystone.service[80832]: *** uWSGI is running in multiple interpreter mode *** Aug 04 21:03:02.446674 dv-cinder-852209-1-smb devstack@keystone.service[80832]: spawned uWSGI master process (pid: 80832) Aug 04 21:03:02.446902 dv-cinder-852209-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 04 21:03:02.447515 dv-cinder-852209-1-smb devstack@keystone.service[80832]: spawned uWSGI worker 1 (pid: 80840, cores: 1) Aug 04 21:03:02.450873 dv-cinder-852209-1-smb devstack@keystone.service[80832]: spawned uWSGI worker 2 (pid: 80841, cores: 1) Aug 04 21:03:02.450873 dv-cinder-852209-1-smb devstack@keystone.service[80832]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 21:03:08.814680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:03:08.814680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: from cryptography.utils import int_from_bytes Aug 04 21:03:08.815995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:03:08.815995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: from cryptography.utils import int_from_bytes Aug 04 21:03:08.828114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:03:08.828114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: from cryptography.utils import int_from_bytes Aug 04 21:03:08.828758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 21:03:08.828758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: from cryptography.utils import int_from_bytes Aug 04 21:03:08.867230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:03:08.867437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:03:08.867586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] command line args: [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:03:08.867852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:03:08.868028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ================================================================================ {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:03:08.868282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] admin_token = **** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.868543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] config_dir = [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.868713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.868920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] config_source = [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.869103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] debug = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.869319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.869731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.870444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.870871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.871206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.871442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] list_limit = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.871682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] log_config_append = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.871866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.872047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] log_dir = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.872226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] log_file = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.872465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.872716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.873056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.873239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.873406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.873569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.873833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.874139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.874471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.874471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.874845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.875071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.875234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.875420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.875664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.876227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.876411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] publish_errors = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.876652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.876901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.877081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.877329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.877563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.877798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] standard_threads = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.878028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.878268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.878443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.878635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] use_journal = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.878793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] use_json = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.878965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] use_stderr = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.879138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] use_syslog = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.879365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.879620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.879866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.880122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.880358 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.880604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.880839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.881109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.881345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.881587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.881833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.882080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.882313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.882739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.882862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 21:03:08.882992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.883100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 21:03:08.883100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] command line args: [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 21:03:08.883325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.883440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 21:03:08.883563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.883669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ================================================================================ {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 21:03:08.883793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.883901 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] admin_token = **** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.884009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.884165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] config_dir = [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.884329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.884482 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.884482 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] config_source = [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.884692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.884809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] debug = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.884984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.885102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.885236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.885345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.885345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.885621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.886210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.886323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.886433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.886554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.886675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] list_limit = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.886857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] log_config_append = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.886976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.887094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.887221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] log_dir = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.887326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.887454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] log_file = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.887569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.887690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.887805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.887921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.888027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.888223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.888375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.888489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.888601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.888725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.888859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.889036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.889143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.889264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.889421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.889527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.889639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.889764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.889879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.889995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.890102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.890228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.890334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.890459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.890575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.890690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.890798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.890917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.891035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.891141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.891253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.891253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.891468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.891588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.891702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] publish_errors = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.891702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.891906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.892014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.892136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.892242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.892352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.892471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.892578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.892687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.892814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.892947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] standard_threads = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.893066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.893176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.893176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.893385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.893579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.893695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.893802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] use_journal = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.893802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] use_json = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.894043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.894149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] use_stderr = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.894274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.894382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] use_syslog = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.894490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.894606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 21:03:08.894712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.894850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.894970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.895967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.896076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.896186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.896314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.896440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.896555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.896662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.896771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.896914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.897046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.897154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.897265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.897375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.897536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.897536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.897766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.897766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.898004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.898004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.898302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.898452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.898615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.898615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.898906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.899054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.899213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.899366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.899710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.899886 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.900058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.900214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.900370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.900494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.900672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.900792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.900976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.901100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.901252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.901425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.901536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.901718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.901830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.902946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.903204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.903336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.903336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.903587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.903707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.903882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.904003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.904197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.904314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.904471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.904595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.904724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.904905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.905046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.905046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.905264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.905419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.905536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.905645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.905774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.905891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.906957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.907067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.907265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.907382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.907493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.907623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.907733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.907887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.908017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] auth.external = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.908143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.908261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.908378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.908502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.908614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.908725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.908848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] auth.password = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] auth.token = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.909958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.910069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.910226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.910226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.910442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.910603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.910712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.910825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.910825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] credential.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.911940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.912938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.913182 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.913301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.913301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.913506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.913614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.913738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.913847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] federation.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.913847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.914059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.914170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.914170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.914523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.914638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.914638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.914889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.915016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.915125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.915237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.915237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.915501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.915761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.915761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.916075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.916203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.916345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.916477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.916477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.916732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.917874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.918155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.918262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.918419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.918592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.918697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.918896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.919012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.919111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.919347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.919451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.919844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.920064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.920158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.920326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.920477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.920634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.920906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.920992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.921189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.921362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.921437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.921693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.921760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.921927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.922164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.922232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.922394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.922598 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.922706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.922855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.923037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.923202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.923325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.923477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.923546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.923885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.923989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.924060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.924253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.924361 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.924497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.924739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.924825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.925090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.925248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.925419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.925506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.925640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.925773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.925906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.926102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.926223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.926374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.926536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.926658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.926864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.926939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] auth.external = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.927079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.927308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.927439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.927561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.927771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.927851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.928016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.928248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.928374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.928491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.928668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] auth.password = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.928749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.928934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.929016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] auth.token = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.929175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.929351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.929429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.929647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.929723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.929890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.930036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.930135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.930379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.930456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.930610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.930687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.930837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.931039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.931117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.931286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.931384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.931582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.931684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] credential.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.931760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.931973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.932051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.932214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.932323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.932463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.933357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.933632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.933760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.934019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.934161 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.934499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.934499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.934695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.934776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.934946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.935998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.936156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.936260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.936413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.936561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.936672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.936748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.936874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] federation.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.937937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.938088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.938166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.938318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.938400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.938553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.938645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.938791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] resource.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.938868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.939039 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.939117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.939287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.939374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.939523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.939600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.939769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.939846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.940976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.941060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.941197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] role.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.941280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.941441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.941532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] role.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.941669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.941748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.942861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.943986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.943986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.946799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.946799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.950650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.950832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.950945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.951931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.952146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.952261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.952378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.952494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.952626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.952738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.952856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.953921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.954932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.955045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.955158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.955282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.955391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.955504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.955504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.955724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.955832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956029 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956364 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956821 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.956951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.957070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.957184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.957297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.957426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.957547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.957674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.957784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] token.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.957898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.958930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.959983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.960100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.960230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.960342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.960458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.960576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.960692 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.960808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.961974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.962092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.connection = **** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.962220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.962343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.962456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.962590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.962703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.962818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.962935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.963051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.963166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.963292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.963406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.963521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.963835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.963995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.964114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.964243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.964355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.964476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.964476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.964694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.964807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.964807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.965910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966235 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.966368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] resource.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.967296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] role.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.968190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] role.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.969129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.969129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.969129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.969129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.969565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.969999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.970428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.970883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.971334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.971745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.972181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.972622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.973077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.973528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.974249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.974662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.975099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.975537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.975980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.976417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.976850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.977319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.977773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.978192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.978589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.979014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.979484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.980038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.980498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.980966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.981312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.981694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.981868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.982018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] token.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.982266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.982522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.982766 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.983027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.983280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.983526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.983775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.984021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.984274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.984509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.984793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.984987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.985246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.985495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.985726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.985968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.986265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.986529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.connection = **** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.986768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.987018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.987252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.987494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.987756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.987956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.988193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.988425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.988665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.988977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.989168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.989359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:08.989583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.989783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:08.989783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:08.990165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.990165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.990542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.990542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.990889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.991149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 21:03:08.991348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 21:03:08.999065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.022344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.022724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.022936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.030769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.031038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.036363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.063533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.063865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.087776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.102356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.146226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.146626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.157680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.157934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.216738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.217074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.217251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.217337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.217523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.217656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.217788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.217932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.218075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.218205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.218205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.218445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.242806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.243071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.243243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.243459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.243669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.243877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.244086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.247747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.247994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.248226 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.248445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.248677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.248876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.249288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.256850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.257568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.271263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.271455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.271540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.271607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.271716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.272065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.272272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.272468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.272665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.272857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.273103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.273311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.273521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80840) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.273718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80841) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 21:03:09.291071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.291376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.291611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 21:03:09.291820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 21:03:09.291820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.292214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.292426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 21:03:09.292643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.292843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 21:03:09.293294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.293496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.293697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.293697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.294090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.294090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.294488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.303573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.303846 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.304110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.304387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.304522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.304800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.305091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.305371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.311991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.312562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.316942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.317254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.317513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.317636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.317786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.317870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.318063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.318158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.318318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.318410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.318580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.318675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.318833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.318924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.319094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.319188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.319358 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.319451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.319625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.319726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.319883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.320142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.344927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.345337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.346342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.346623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.346855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.347132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.351233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.351505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.351775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.351887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.352094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.352372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.358722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.358991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.359085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.359269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.363026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.363309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.363487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.363631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.363768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.363904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.364035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.364184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.364319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.364435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.364595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.364716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.364961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.365118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.365517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.365810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.381390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.381668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.386026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.386324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.386452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.389617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.389907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.390700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.393868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.394157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.394472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.397569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.398571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.400849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.401227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.402146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.402629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.402950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.403207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.403573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.409051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.409496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.409928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.410380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.410784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.411098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.420507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.420836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.421199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.421464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.428354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.429929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.430195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.433228 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.433627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.434026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.434432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.434786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.435049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.435348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.435615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.436007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.444966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.446652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.446931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.447205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.447416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.447545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.447668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.447871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.448666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.449099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.453179 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.453458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.453747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.454027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.454314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.466478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.467686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.468015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.468345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.468671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.469073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.469420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.469761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.470781 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.475497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.478843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.481750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.482136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.482471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.486896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.491065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.491459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.492928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.494769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.500747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.500747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.501106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.501263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.501263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.501589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.501589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.501589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.507827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.509493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.509906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.510201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.510514 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.512699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.513003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.513284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.513558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.517914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80840) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.518189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.518467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.518741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.519009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.519313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.519590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.519877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.520253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.520520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.520787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.521070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.521349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.521610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.521741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80840) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.521895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.522172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.531398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80841) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 21:03:09.531677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.531966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.532235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.532498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.532765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.533062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.533343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.533740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.534008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.534275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.534532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.534791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.535053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80841) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 21:03:09.558775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dbd9d369c0 pid: 80840 (default app) Aug 04 21:03:09.562257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead83537-e837-48d7-a485-8e3dd9f073e3 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:09.562539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead83537-e837-48d7-a485-8e3dd9f073e3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:09.562810 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead83537-e837-48d7-a485-8e3dd9f073e3 None None] PATH_INFO: `/v3` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:09.567096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 791 bytes} [Thu Aug 4 21:03:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:09.571378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dbd9d369c0 pid: 80841 (default app) Aug 04 21:03:18.462939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2c431-210b-4ad7-a6a5-10cc54106544 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:18.463522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2c431-210b-4ad7-a6a5-10cc54106544 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:18.463522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2c431-210b-4ad7-a6a5-10cc54106544 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:18.465329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 2/2] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:03:18.473514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:18.474083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:18.474083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:18.560272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: INFO dbcounter [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] Registered counter for database keystone Aug 04 21:03:18.581288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG oslo_db.sqlalchemy.engines [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:03:18.593945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writer thread running {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:03:18.795841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG passlib.handlers.bcrypt [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80841) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 21:03:18.796296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG passlib.handlers.bcrypt [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80841) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 21:03:18.853024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:18.855367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:19.000108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1/3] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 04 21:03:19.163857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2c431-210b-4ad7-a6a5-10cc54106544 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:19.236406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: INFO dbcounter [None req-dbf2c431-210b-4ad7-a6a5-10cc54106544 None None] Registered counter for database keystone Aug 04 21:03:19.259798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG oslo_db.sqlalchemy.engines [None req-dbf2c431-210b-4ad7-a6a5-10cc54106544 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 21:03:19.267423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writer thread running {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 21:03:19.390457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2c431-210b-4ad7-a6a5-10cc54106544 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:19.395192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511719b6-4809-48f9-b08f-a497677ac557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:19.395847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511719b6-4809-48f9-b08f-a497677ac557 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:19.396133 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511719b6-4809-48f9-b08f-a497677ac557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:19.396407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511719b6-4809-48f9-b08f-a497677ac557 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:19.407547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511719b6-4809-48f9-b08f-a497677ac557 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:19.466618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING keystone.common.rbac_enforcer.enforcer [None req-511719b6-4809-48f9-b08f-a497677ac557 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 21:03:19.467256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511719b6-4809-48f9-b08f-a497677ac557 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:19.478127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 3/4] 10.222.0.93 () {58 vars in 1324 bytes} [Thu Aug 4 21:03:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:03:19.486205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:19.506056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ca07-a92e-4dc9-ae0a-316630d81a73 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:19.511582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca7ab-082a-40b6-9347-13a06caf1edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:19.512945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca7ab-082a-40b6-9347-13a06caf1edd admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:19.513230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca7ab-082a-40b6-9347-13a06caf1edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:19.513504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca7ab-082a-40b6-9347-13a06caf1edd admin admin] PATH_INFO: `/v3/projects/fec42bd454d34bf891854ee5fd76a3ae` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:19.515184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca7ab-082a-40b6-9347-13a06caf1edd admin admin] RBAC: Authorizing `identity:get_project(project_id=fec42bd454d34bf891854ee5fd76a3ae)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:19.568223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5e0ca7ab-082a-40b6-9347-13a06caf1edd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 21:03:19.568545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca7ab-082a-40b6-9347-13a06caf1edd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:19.573937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 2/5] 10.222.0.93 () {56 vars in 1207 bytes} [Thu Aug 4 21:03:19 2022] GET /identity/v3/projects/fec42bd454d34bf891854ee5fd76a3ae => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:21.691125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675545b-a3c8-4586-8191-fcf95a3bfabd None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:21.691686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675545b-a3c8-4586-8191-fcf95a3bfabd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:21.691686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675545b-a3c8-4586-8191-fcf95a3bfabd None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:21.695768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 4/6] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:03:21.701548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810c3dc-bdad-4461-a607-d38c44181464 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:21.702223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810c3dc-bdad-4461-a607-d38c44181464 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:21.702223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810c3dc-bdad-4461-a607-d38c44181464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:21.723212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9810c3dc-bdad-4461-a607-d38c44181464 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:21.724761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9810c3dc-bdad-4461-a607-d38c44181464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:21.733979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 3/7] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 21:03:21.756226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675545b-a3c8-4586-8191-fcf95a3bfabd None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:21.768799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675545b-a3c8-4586-8191-fcf95a3bfabd None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:21.772992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d25737-db77-459a-b911-22edfda755a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:21.773601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25737-db77-459a-b911-22edfda755a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:21.773875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25737-db77-459a-b911-22edfda755a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:21.774145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25737-db77-459a-b911-22edfda755a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:21.783304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d25737-db77-459a-b911-22edfda755a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:21.785194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d25737-db77-459a-b911-22edfda755a3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:21.795285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 5/8] 10.222.0.93 () {58 vars in 1324 bytes} [Thu Aug 4 21:03:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:03:21.801041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810c3dc-bdad-4461-a607-d38c44181464 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:21.811172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810c3dc-bdad-4461-a607-d38c44181464 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:21.815600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab310e6-b713-4c2c-a893-2ff8d28bf395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:21.816238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab310e6-b713-4c2c-a893-2ff8d28bf395 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:21.816520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab310e6-b713-4c2c-a893-2ff8d28bf395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:21.816797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab310e6-b713-4c2c-a893-2ff8d28bf395 admin admin] PATH_INFO: `/v3/users/0b3130018efa44a5a2048fca15b5c1f6` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:21.818202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab310e6-b713-4c2c-a893-2ff8d28bf395 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b3130018efa44a5a2048fca15b5c1f6)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:21.820042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab310e6-b713-4c2c-a893-2ff8d28bf395 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:21.821729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 4/9] 10.222.0.93 () {56 vars in 1198 bytes} [Thu Aug 4 21:03:21 2022] GET /identity/v3/users/0b3130018efa44a5a2048fca15b5c1f6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:23.989442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab16ce-1399-4600-9f7c-7579576702ea None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:23.990132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab16ce-1399-4600-9f7c-7579576702ea None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:23.990132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab16ce-1399-4600-9f7c-7579576702ea None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:23.991321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 6/10] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:23.997376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670df3b-0656-437e-aba9-c052baf4bfc3 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:23.998149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670df3b-0656-437e-aba9-c052baf4bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:23.998149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670df3b-0656-437e-aba9-c052baf4bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.019089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b670df3b-0656-437e-aba9-c052baf4bfc3 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:24.020290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b670df3b-0656-437e-aba9-c052baf4bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:24.069761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec000a1-294f-49ff-992d-b6afa6ea3d0f None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:24.070041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec000a1-294f-49ff-992d-b6afa6ea3d0f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:24.070955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec000a1-294f-49ff-992d-b6afa6ea3d0f None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.073122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 7/11] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:24.077253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:24.077541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:24.077820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.112596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 5/12] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:24.122550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG passlib.handlers.bcrypt [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80840) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 21:03:24.122999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG passlib.handlers.bcrypt [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80840) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 21:03:24.136552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670df3b-0656-437e-aba9-c052baf4bfc3 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:24.165666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:24.169727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:24.171393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:24.249894 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670df3b-0656-437e-aba9-c052baf4bfc3 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:24.279365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 8/13] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:24.286749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1ef7-20f7-4538-9cc2-47d323fce355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:24.287404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1ef7-20f7-4538-9cc2-47d323fce355 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:24.287687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1ef7-20f7-4538-9cc2-47d323fce355 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:24.287964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db1ef7-20f7-4538-9cc2-47d323fce355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.300567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db1ef7-20f7-4538-9cc2-47d323fce355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:24.302065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-43db1ef7-20f7-4538-9cc2-47d323fce355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:24.309734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:24.310810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:24.311826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 6/14] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:03:24.316945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1ef7-20f7-4538-9cc2-47d323fce355 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:24.406568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:24.412478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc114e-b306-4cfe-bc28-25817f97c1c8 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:24.415859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:24.426347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db1ef7-20f7-4538-9cc2-47d323fce355 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:24.457955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974eb47-5f7d-46f1-8eb3-f73691171f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:24.458846 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974eb47-5f7d-46f1-8eb3-f73691171f00 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:24.459165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974eb47-5f7d-46f1-8eb3-f73691171f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:24.459473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974eb47-5f7d-46f1-8eb3-f73691171f00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.465889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:24.466517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:24.466801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:24.467074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.467840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:24.468143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:24.469609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:24.482807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 7/15] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:24.488414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:24.540500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974eb47-5f7d-46f1-8eb3-f73691171f00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:24.542675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974eb47-5f7d-46f1-8eb3-f73691171f00 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:24.607194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbce5b-2a56-4f51-a415-7588b12570a1 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:24.649346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc984-5054-4434-afda-7e77d66020b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:24.649987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc984-5054-4434-afda-7e77d66020b2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:24.650193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 9/16] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:24.650292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc984-5054-4434-afda-7e77d66020b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:24.651125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc984-5054-4434-afda-7e77d66020b2 None admin] PATH_INFO: `/v3/users/0b3130018efa44a5a2048fca15b5c1f6` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.653004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc984-5054-4434-afda-7e77d66020b2 None admin] RBAC: Authorizing `identity:get_user(user_id=0b3130018efa44a5a2048fca15b5c1f6)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:24.654479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cc984-5054-4434-afda-7e77d66020b2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:24.656214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 8/17] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:24 2022] GET /identity/v3/users/0b3130018efa44a5a2048fca15b5c1f6 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:24.657105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974eb47-5f7d-46f1-8eb3-f73691171f00 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:24.660401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:24.661951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc984-5054-4434-afda-7e77d66020b2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:24.678428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:24.798528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974eb47-5f7d-46f1-8eb3-f73691171f00 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:24.836113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:24.837011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:24.837293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:24.837572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.858045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:24.859635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:03:24.879036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:24.880142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:24.880972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:03:24.880972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:03:24.880972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:03:24.880972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:24.880972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 10/18] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:03:24.883794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cc984-5054-4434-afda-7e77d66020b2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:24.886991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:24.922590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3f743-bb8d-4da6-b581-93878503cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:24.923303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3f743-bb8d-4da6-b581-93878503cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:24.923591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3f743-bb8d-4da6-b581-93878503cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:24.923873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3f743-bb8d-4da6-b581-93878503cbe6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:24.925096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3f743-bb8d-4da6-b581-93878503cbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:24.926556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3f743-bb8d-4da6-b581-93878503cbe6 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:24.928164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 9/19] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:24.935087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3f743-bb8d-4da6-b581-93878503cbe6 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:24.947753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:24.995559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f7ab-fcbc-42d3-8e9a-a4c91fdde4ef None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:25.021472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:25.030143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fe6a-4e6f-4f89-94c6-55159c0ea424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:25.030767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fe6a-4e6f-4f89-94c6-55159c0ea424 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:25.031070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fe6a-4e6f-4f89-94c6-55159c0ea424 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:25.035086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fe6a-4e6f-4f89-94c6-55159c0ea424 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:25.035086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389fe6a-4e6f-4f89-94c6-55159c0ea424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:25.035086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389fe6a-4e6f-4f89-94c6-55159c0ea424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:25.035086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389fe6a-4e6f-4f89-94c6-55159c0ea424 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:25.040481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3f743-bb8d-4da6-b581-93878503cbe6 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:25.052966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 11/20] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:25.083434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebe2a0-1f3e-4282-be11-6aa0e5770adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:25.083991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebe2a0-1f3e-4282-be11-6aa0e5770adf None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:25.084272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebe2a0-1f3e-4282-be11-6aa0e5770adf None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:25.084543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebe2a0-1f3e-4282-be11-6aa0e5770adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:25.085413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebe2a0-1f3e-4282-be11-6aa0e5770adf None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.domain.id=default, user.id=0b3130018efa44a5a2048fca15b5c1f6) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:25.085720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebe2a0-1f3e-4282-be11-6aa0e5770adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:25.087223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebe2a0-1f3e-4282-be11-6aa0e5770adf None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:25.096934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 10/21] 10.222.0.93 () {56 vars in 1322 bytes} [Thu Aug 4 21:03:24 2022] GET /identity/v3/role_assignments?user.id=0b3130018efa44a5a2048fca15b5c1f6&scope.domain.id=default&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:27.732108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fada6-025c-4b69-9244-bdfc4469955a None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:27.732726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fada6-025c-4b69-9244-bdfc4469955a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:27.732726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fada6-025c-4b69-9244-bdfc4469955a None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:27.734037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 12/22] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:27.739832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f06a-a6c0-4eba-bcff-543f3d6f7235 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:27.740288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f06a-a6c0-4eba-bcff-543f3d6f7235 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:27.740379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f06a-a6c0-4eba-bcff-543f3d6f7235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:27.766987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1812f06a-a6c0-4eba-bcff-543f3d6f7235 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:27.768138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1812f06a-a6c0-4eba-bcff-543f3d6f7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:27.873586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 11/23] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:27.918362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fada6-025c-4b69-9244-bdfc4469955a None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:28.069822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fada6-025c-4b69-9244-bdfc4469955a None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:28.093603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:28.114654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cc3e3-8099-4031-915e-bfe5891dd88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:28.115591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cc3e3-8099-4031-915e-bfe5891dd88a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.115955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cc3e3-8099-4031-915e-bfe5891dd88a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.116355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cc3e3-8099-4031-915e-bfe5891dd88a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.133936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cc3e3-8099-4031-915e-bfe5891dd88a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-628cc3e3-8099-4031-915e-bfe5891dd88a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:28.145223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:28.146122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:28.146861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 13/24] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:28.153584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812f06a-a6c0-4eba-bcff-543f3d6f7235 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:28.261775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:28.279795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331f28-0e5f-4194-b707-88c8b325aea4 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.280210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331f28-0e5f-4194-b707-88c8b325aea4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.280637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1331f28-0e5f-4194-b707-88c8b325aea4 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.282749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 14/25] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:03:28.289084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07033b1-b696-41e4-aef4-3df5c753e74a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.289381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07033b1-b696-41e4-aef4-3df5c753e74a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.289758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07033b1-b696-41e4-aef4-3df5c753e74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.300810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812f06a-a6c0-4eba-bcff-543f3d6f7235 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:28.352071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf9ef0-364a-46d2-8e5e-eebb6e0bcd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:28.352638 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9ef0-364a-46d2-8e5e-eebb6e0bcd17 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.353056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9ef0-364a-46d2-8e5e-eebb6e0bcd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.353342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9ef0-364a-46d2-8e5e-eebb6e0bcd17 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.354189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf9ef0-364a-46d2-8e5e-eebb6e0bcd17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:28.354587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf9ef0-364a-46d2-8e5e-eebb6e0bcd17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:28.356501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf9ef0-364a-46d2-8e5e-eebb6e0bcd17 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:28.366773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 12/26] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:28.368090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff6ca-517b-4c6b-907d-78118e611d70 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.368381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff6ca-517b-4c6b-907d-78118e611d70 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.368660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff6ca-517b-4c6b-907d-78118e611d70 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.370881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 13/27] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:28.372353 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fda952-4142-4f65-bc5c-0b5bef3d0081 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.372637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fda952-4142-4f65-bc5c-0b5bef3d0081 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.372934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fda952-4142-4f65-bc5c-0b5bef3d0081 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.374640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 14/28] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:28.380166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611809-b0e1-438f-b911-b76b9f9df1d4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.380446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611809-b0e1-438f-b911-b76b9f9df1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.380719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611809-b0e1-438f-b911-b76b9f9df1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.403010 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-77611809-b0e1-438f-b911-b76b9f9df1d4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:28.404320 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-77611809-b0e1-438f-b911-b76b9f9df1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:28.447440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f07033b1-b696-41e4-aef4-3df5c753e74a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:28.448865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f07033b1-b696-41e4-aef4-3df5c753e74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:28.494032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 15/29] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:28.495379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be762f1-294d-45c6-ab16-97547dfcdf43 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.495760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be762f1-294d-45c6-ab16-97547dfcdf43 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.496802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be762f1-294d-45c6-ab16-97547dfcdf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.522510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-6be762f1-294d-45c6-ab16-97547dfcdf43 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:28.523723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6be762f1-294d-45c6-ab16-97547dfcdf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:28.526254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 15/30] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:28.527606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07033b1-b696-41e4-aef4-3df5c753e74a None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:28.604823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:28.615260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 16/31] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:28.616060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be762f1-294d-45c6-ab16-97547dfcdf43 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:28.675184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07033b1-b696-41e4-aef4-3df5c753e74a None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:28.686676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:28.724351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436962-02c1-4630-b464-5400e4e05960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:28.725416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436962-02c1-4630-b464-5400e4e05960 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.725894 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436962-02c1-4630-b464-5400e4e05960 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.726450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436962-02c1-4630-b464-5400e4e05960 None admin] PATH_INFO: `/v3/users/0b3130018efa44a5a2048fca15b5c1f6` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.728062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10436962-02c1-4630-b464-5400e4e05960 None admin] RBAC: Authorizing `identity:get_user(user_id=0b3130018efa44a5a2048fca15b5c1f6)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:28.730755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10436962-02c1-4630-b464-5400e4e05960 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:28.737670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 16/32] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:28 2022] GET /identity/v3/users/0b3130018efa44a5a2048fca15b5c1f6 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:28.737670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436962-02c1-4630-b464-5400e4e05960 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:28.774903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be762f1-294d-45c6-ab16-97547dfcdf43 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:28.820643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730b919-177d-49ab-8509-2f4e53e585fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:28.821671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730b919-177d-49ab-8509-2f4e53e585fd None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.822127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730b919-177d-49ab-8509-2f4e53e585fd None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.822608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730b919-177d-49ab-8509-2f4e53e585fd None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.823522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730b919-177d-49ab-8509-2f4e53e585fd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:28.825518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730b919-177d-49ab-8509-2f4e53e585fd None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:28.885245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436962-02c1-4630-b464-5400e4e05960 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:28.928188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1c70e-419a-400e-9567-fe152e6ab8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:28.929224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c70e-419a-400e-9567-fe152e6ab8d7 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:28.929636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c70e-419a-400e-9567-fe152e6ab8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:28.930022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c70e-419a-400e-9567-fe152e6ab8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:28.931361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1c70e-419a-400e-9567-fe152e6ab8d7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:28.933478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1c70e-419a-400e-9567-fe152e6ab8d7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:29.050387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 17/33] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Aug 4 21:03:28 2022] POST /identity/v3/roles => generated 219 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:29.051795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730b919-177d-49ab-8509-2f4e53e585fd None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:29.129022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:29.140824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 17/34] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Aug 4 21:03:28 2022] POST /identity/v3/roles => generated 225 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:29.142371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1c70e-419a-400e-9567-fe152e6ab8d7 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:29.205115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:29.236934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730b919-177d-49ab-8509-2f4e53e585fd None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:29.293922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7442a-6ad0-40ba-bcc8-5cc2b51f9107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:29.294863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7442a-6ad0-40ba-bcc8-5cc2b51f9107 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.295201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7442a-6ad0-40ba-bcc8-5cc2b51f9107 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.295484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7442a-6ad0-40ba-bcc8-5cc2b51f9107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.315307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7442a-6ad0-40ba-bcc8-5cc2b51f9107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:29.318130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7442a-6ad0-40ba-bcc8-5cc2b51f9107 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:29.319862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1c70e-419a-400e-9567-fe152e6ab8d7 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-1fe7442a-6ad0-40ba-bcc8-5cc2b51f9107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:03:29.343714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:29.344710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:29.345732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:03:29.345732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:03:29.345732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:03:29.345732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:29.345732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 18/35] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:29.346248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936b50-8bb1-4e81-948c-bc9da2b21321 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.346529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936b50-8bb1-4e81-948c-bc9da2b21321 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.346800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936b50-8bb1-4e81-948c-bc9da2b21321 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.349347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 19/36] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:29.353177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb53f-9bd7-4fbc-b221-4d42af59b795 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.354349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb53f-9bd7-4fbc-b221-4d42af59b795 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.354631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb53f-9bd7-4fbc-b221-4d42af59b795 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.357184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 20/37] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:29.361592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb53f-9bd7-4fbc-b221-4d42af59b795 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:29.368443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b897c2-4834-4147-b395-d5a725ba2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:29.369366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b897c2-4834-4147-b395-d5a725ba2c77 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.369785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b897c2-4834-4147-b395-d5a725ba2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.370274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b897c2-4834-4147-b395-d5a725ba2c77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.371742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b897c2-4834-4147-b395-d5a725ba2c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:29.373383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b897c2-4834-4147-b395-d5a725ba2c77 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:29.375936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 18/38] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:29.376236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6058b-404d-4675-841c-7e7a74ba2f17 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.376558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6058b-404d-4675-841c-7e7a74ba2f17 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.376855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6058b-404d-4675-841c-7e7a74ba2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.397333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0bd6058b-404d-4675-841c-7e7a74ba2f17 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:29.398785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0bd6058b-404d-4675-841c-7e7a74ba2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:29.475076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 19/39] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:29.476343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b3c6-8c2e-405a-964e-1b298a9bccf2 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.476626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b3c6-8c2e-405a-964e-1b298a9bccf2 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.476931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b3c6-8c2e-405a-964e-1b298a9bccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.493669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb53f-9bd7-4fbc-b221-4d42af59b795 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:29.500900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-5b22b3c6-8c2e-405a-964e-1b298a9bccf2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:29.502122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5b22b3c6-8c2e-405a-964e-1b298a9bccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:29.504547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:29.532916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:29.533561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.533850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.534129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.534828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:29.535139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:29.536622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:29.536730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:29.556695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 21/40] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:29.557545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:29.585547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 20/41] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:29.586486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22b3c6-8c2e-405a-964e-1b298a9bccf2 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:29.673382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce149-e86d-47c7-aca9-2879536f869d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:29.703645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22b3c6-8c2e-405a-964e-1b298a9bccf2 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:29.710870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cce4ec-f19b-466f-9ab5-d9696f213827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:29.711636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cce4ec-f19b-466f-9ab5-d9696f213827 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.712483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cce4ec-f19b-466f-9ab5-d9696f213827 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.712483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cce4ec-f19b-466f-9ab5-d9696f213827 None admin] PATH_INFO: `/v3/domains/default/users/0b3130018efa44a5a2048fca15b5c1f6/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.714543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cce4ec-f19b-466f-9ab5-d9696f213827 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0b3130018efa44a5a2048fca15b5c1f6, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:29.716254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cce4ec-f19b-466f-9ab5-d9696f213827 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:29.740018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23ff2-010d-4903-8e57-a6c10641d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:29.740649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23ff2-010d-4903-8e57-a6c10641d525 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:29.740965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23ff2-010d-4903-8e57-a6c10641d525 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:29.741236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23ff2-010d-4903-8e57-a6c10641d525 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:29.741950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23ff2-010d-4903-8e57-a6c10641d525 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:29.743335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23ff2-010d-4903-8e57-a6c10641d525 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:29.823158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 22/42] 10.222.0.93 () {58 vars in 1361 bytes} [Thu Aug 4 21:03:29 2022] PUT /identity/v3/domains/default/users/0b3130018efa44a5a2048fca15b5c1f6/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:29.824075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cce4ec-f19b-466f-9ab5-d9696f213827 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:29.837619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 21/43] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Aug 4 21:03:29 2022] POST /identity/v3/roles => generated 223 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:29.840028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23ff2-010d-4903-8e57-a6c10641d525 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:29.862866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:29.897215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:29.982614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cce4ec-f19b-466f-9ab5-d9696f213827 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:30.023129 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23ff2-010d-4903-8e57-a6c10641d525 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:30.027681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62830394-b1b5-4294-bf77-89892f9b08d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:30.028338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830394-b1b5-4294-bf77-89892f9b08d2 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:30.028623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830394-b1b5-4294-bf77-89892f9b08d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:30.029757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62830394-b1b5-4294-bf77-89892f9b08d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:30.029757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62830394-b1b5-4294-bf77-89892f9b08d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:30.031178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62830394-b1b5-4294-bf77-89892f9b08d2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:30.071623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4173d9-42bc-4332-8554-f44cd5c492e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:30.072398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4173d9-42bc-4332-8554-f44cd5c492e8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:30.073302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4173d9-42bc-4332-8554-f44cd5c492e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:30.073586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4173d9-42bc-4332-8554-f44cd5c492e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:30.074805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4173d9-42bc-4332-8554-f44cd5c492e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:30.076258 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4173d9-42bc-4332-8554-f44cd5c492e8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:30.078315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 22/44] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:30.084024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4173d9-42bc-4332-8554-f44cd5c492e8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:30.138220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 23/45] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:03:29 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:30.211694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:30.225208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4173d9-42bc-4332-8554-f44cd5c492e8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:30.272429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68281c86-9f2a-463a-97d8-118fde5b0100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:30.273005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68281c86-9f2a-463a-97d8-118fde5b0100 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:30.273290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68281c86-9f2a-463a-97d8-118fde5b0100 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:30.273701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68281c86-9f2a-463a-97d8-118fde5b0100 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:30.274663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68281c86-9f2a-463a-97d8-118fde5b0100 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:30.277689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68281c86-9f2a-463a-97d8-118fde5b0100 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:30.363571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 23/46] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:03:30 2022] POST /identity/v3/projects => generated 312 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:03:31.989137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a4fe-f59e-4264-880e-4f906aed3a2f None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:31.989680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a4fe-f59e-4264-880e-4f906aed3a2f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:31.989680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a4fe-f59e-4264-880e-4f906aed3a2f None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:31.991043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 24/47] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:31.997433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73cada-6bb2-48e8-986e-192fbe29bab1 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:31.998161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73cada-6bb2-48e8-986e-192fbe29bab1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:31.998161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73cada-6bb2-48e8-986e-192fbe29bab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.016801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ea73cada-6bb2-48e8-986e-192fbe29bab1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:32.018026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ea73cada-6bb2-48e8-986e-192fbe29bab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:32.087820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 24/48] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:32.111921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a4fe-f59e-4264-880e-4f906aed3a2f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:32.207363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:32.227913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a4fe-f59e-4264-880e-4f906aed3a2f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:32.262545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7412ab4-ccae-46fd-97e6-98814477eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:32.263107 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412ab4-ccae-46fd-97e6-98814477eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.263388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412ab4-ccae-46fd-97e6-98814477eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.263659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412ab4-ccae-46fd-97e6-98814477eaa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.276458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7412ab4-ccae-46fd-97e6-98814477eaa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-d7412ab4-ccae-46fd-97e6-98814477eaa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:32.281540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:32.282412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:32.283262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 25/49] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:03:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:32.288794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73cada-6bb2-48e8-986e-192fbe29bab1 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:32.364701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:32.396393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73cada-6bb2-48e8-986e-192fbe29bab1 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:32.436973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ebea9-be46-45ed-a7c4-db4d143c7d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:32.437592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebea9-be46-45ed-a7c4-db4d143c7d89 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.437922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebea9-be46-45ed-a7c4-db4d143c7d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.438200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebea9-be46-45ed-a7c4-db4d143c7d89 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.439090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebea9-be46-45ed-a7c4-db4d143c7d89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:32.439253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebea9-be46-45ed-a7c4-db4d143c7d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:32.442201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebea9-be46-45ed-a7c4-db4d143c7d89 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:32.455917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 25/50] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:32.468220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7412ab4-ccae-46fd-97e6-98814477eaa7 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:32.481955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf04b2-9707-44ea-adff-11d129e0359a None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.482248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf04b2-9707-44ea-adff-11d129e0359a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.482521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf04b2-9707-44ea-adff-11d129e0359a None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.483885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 26/51] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:03:32.489175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ffdd-e451-4b97-aeaa-9136ac637347 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.489462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ffdd-e451-4b97-aeaa-9136ac637347 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.489743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ffdd-e451-4b97-aeaa-9136ac637347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.508029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2013ffdd-e451-4b97-aeaa-9136ac637347 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:32.509420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2013ffdd-e451-4b97-aeaa-9136ac637347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:32.581552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7412ab4-ccae-46fd-97e6-98814477eaa7 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:32.581753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 27/52] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:32.605392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ffdd-e451-4b97-aeaa-9136ac637347 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:32.618993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf4cea-818a-4349-a9ea-6bbcd002a96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:32.619790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4cea-818a-4349-a9ea-6bbcd002a96e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.620073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4cea-818a-4349-a9ea-6bbcd002a96e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.620348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4cea-818a-4349-a9ea-6bbcd002a96e None admin] PATH_INFO: `/v3/users/0b3130018efa44a5a2048fca15b5c1f6` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.621546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf4cea-818a-4349-a9ea-6bbcd002a96e None admin] RBAC: Authorizing `identity:get_user(user_id=0b3130018efa44a5a2048fca15b5c1f6)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:32.623000 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf4cea-818a-4349-a9ea-6bbcd002a96e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:32.624593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 26/53] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:32 2022] GET /identity/v3/users/0b3130018efa44a5a2048fca15b5c1f6 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:32.629898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf4cea-818a-4349-a9ea-6bbcd002a96e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:32.641191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:32.671011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:32.709191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ffdd-e451-4b97-aeaa-9136ac637347 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:32.737117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf4cea-818a-4349-a9ea-6bbcd002a96e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:32.744837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b5984-b140-4d93-a062-3b3216957e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:32.745660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b5984-b140-4d93-a062-3b3216957e49 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.745939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b5984-b140-4d93-a062-3b3216957e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.746205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b5984-b140-4d93-a062-3b3216957e49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.747515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b5984-b140-4d93-a062-3b3216957e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:32.749001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b5984-b140-4d93-a062-3b3216957e49 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:32.750601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 28/54] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:32.756792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b5984-b140-4d93-a062-3b3216957e49 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:32.772854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c55b8-44db-4299-88a5-7c65a6aaf7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:32.773543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c55b8-44db-4299-88a5-7c65a6aaf7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.773827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c55b8-44db-4299-88a5-7c65a6aaf7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.774105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c55b8-44db-4299-88a5-7c65a6aaf7b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.775509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c55b8-44db-4299-88a5-7c65a6aaf7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:32.776954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c55b8-44db-4299-88a5-7c65a6aaf7b6 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:32.778579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 27/55] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:32.784325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c55b8-44db-4299-88a5-7c65a6aaf7b6 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:32.859289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b5984-b140-4d93-a062-3b3216957e49 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:32.862021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:32.886061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c55b8-44db-4299-88a5-7c65a6aaf7b6 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:32.889470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:32.894308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660f6fe-ccc9-4bde-b072-4dee3b7a2b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:32.894924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f6fe-ccc9-4bde-b072-4dee3b7a2b07 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.895210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f6fe-ccc9-4bde-b072-4dee3b7a2b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.895484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f6fe-ccc9-4bde-b072-4dee3b7a2b07 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.896185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660f6fe-ccc9-4bde-b072-4dee3b7a2b07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:32.897645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660f6fe-ccc9-4bde-b072-4dee3b7a2b07 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:32.920966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc8bc5-23ac-464e-b6ff-d02d45554bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:32.921589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc8bc5-23ac-464e-b6ff-d02d45554bed None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:32.921878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc8bc5-23ac-464e-b6ff-d02d45554bed None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:32.922159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc8bc5-23ac-464e-b6ff-d02d45554bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:32.922955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc8bc5-23ac-464e-b6ff-d02d45554bed None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.domain.id=default, user.id=0b3130018efa44a5a2048fca15b5c1f6) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:32.923264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc8bc5-23ac-464e-b6ff-d02d45554bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:32.924794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc8bc5-23ac-464e-b6ff-d02d45554bed None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:32.930601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 28/56] 10.222.0.93 () {56 vars in 1322 bytes} [Thu Aug 4 21:03:32 2022] GET /identity/v3/role_assignments?user.id=0b3130018efa44a5a2048fca15b5c1f6&scope.domain.id=default&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:33.031168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 29/57] 10.222.0.93 () {60 vars in 1140 bytes} [Thu Aug 4 21:03:32 2022] POST /identity/v3/projects => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:03:35.134431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c52d1-041a-44eb-9d2b-e4df32d16d09 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:35.134967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c52d1-041a-44eb-9d2b-e4df32d16d09 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:35.134967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c52d1-041a-44eb-9d2b-e4df32d16d09 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:35.136736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 29/58] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:35.142374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f45d7-1c70-4d0c-b4c0-3c112ed733f6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:35.142804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f45d7-1c70-4d0c-b4c0-3c112ed733f6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:35.142930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f45d7-1c70-4d0c-b4c0-3c112ed733f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:35.161474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e67f45d7-1c70-4d0c-b4c0-3c112ed733f6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:35.162680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e67f45d7-1c70-4d0c-b4c0-3c112ed733f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:35.234201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 30/59] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:35.258447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c52d1-041a-44eb-9d2b-e4df32d16d09 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:35.370249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c52d1-041a-44eb-9d2b-e4df32d16d09 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:35.406454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4ab40-9c03-4408-859e-c807a29c702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:35.407024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4ab40-9c03-4408-859e-c807a29c702d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:35.407308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4ab40-9c03-4408-859e-c807a29c702d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:35.407580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4ab40-9c03-4408-859e-c807a29c702d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:35.408758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4ab40-9c03-4408-859e-c807a29c702d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:35.410246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4ab40-9c03-4408-859e-c807a29c702d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:35.411842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 30/60] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:35.419451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f45d7-1c70-4d0c-b4c0-3c112ed733f6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:35.525087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f45d7-1c70-4d0c-b4c0-3c112ed733f6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:35.540251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:35.562292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc37aa-60c0-4450-837e-dadac442b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:35.568976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc37aa-60c0-4450-837e-dadac442b228 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:35.568976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc37aa-60c0-4450-837e-dadac442b228 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:35.568976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc37aa-60c0-4450-837e-dadac442b228 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:35.568976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc37aa-60c0-4450-837e-dadac442b228 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:35.568976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc37aa-60c0-4450-837e-dadac442b228 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:35.721041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 31/61] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:03:35 2022] POST /identity/v3/users => generated 275 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:38.998022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63885-3a2c-4a6a-ba1c-0103792481d5 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:38.999078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63885-3a2c-4a6a-ba1c-0103792481d5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:38.999583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63885-3a2c-4a6a-ba1c-0103792481d5 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.001167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 31/62] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:39.006898 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575aff-cc7d-4671-b156-baf67a016be3 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.007345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575aff-cc7d-4671-b156-baf67a016be3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.007440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575aff-cc7d-4671-b156-baf67a016be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.038034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-90575aff-cc7d-4671-b156-baf67a016be3 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:39.039293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-90575aff-cc7d-4671-b156-baf67a016be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:39.135094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 32/63] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:39.150152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac450008-98b2-4df8-a19f-eab1c452aca8 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.151328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac450008-98b2-4df8-a19f-eab1c452aca8 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.151881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac450008-98b2-4df8-a19f-eab1c452aca8 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.154051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 32/64] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:39.159575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f438-4be9-426f-9f9d-d8f082e53f86 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.159884 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f438-4be9-426f-9f9d-d8f082e53f86 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.160168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f438-4be9-426f-9f9d-d8f082e53f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.185322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac450008-98b2-4df8-a19f-eab1c452aca8 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:39.187898 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2d30f438-4be9-426f-9f9d-d8f082e53f86 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:39.190668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2d30f438-4be9-426f-9f9d-d8f082e53f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:39.216212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:39.297317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 33/65] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:39.300012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b006c-5692-4ace-bfcc-9b71c4fbe8cd None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.300757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b006c-5692-4ace-bfcc-9b71c4fbe8cd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.301259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b006c-5692-4ace-bfcc-9b71c4fbe8cd None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.302835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 34/66] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:39.318575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe7c58-5f9b-414c-824e-2d34c01ffdee None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.319188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe7c58-5f9b-414c-824e-2d34c01ffdee None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.319654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe7c58-5f9b-414c-824e-2d34c01ffdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.335136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac450008-98b2-4df8-a19f-eab1c452aca8 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:39.350861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-fdfe7c58-5f9b-414c-824e-2d34c01ffdee None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:39.352550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fdfe7c58-5f9b-414c-824e-2d34c01ffdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:39.374111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6d618-86f1-48da-a6f8-74a3b531a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:39.375266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6d618-86f1-48da-a6f8-74a3b531a67c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.375704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6d618-86f1-48da-a6f8-74a3b531a67c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.376123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6d618-86f1-48da-a6f8-74a3b531a67c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.380412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:39.388635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6d618-86f1-48da-a6f8-74a3b531a67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-baf6d618-86f1-48da-a6f8-74a3b531a67c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:39.394491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:39.395530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:39.396528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:39.398997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 33/67] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:39.399987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6d618-86f1-48da-a6f8-74a3b531a67c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:39.449078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 35/68] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:39.450209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe7c58-5f9b-414c-824e-2d34c01ffdee None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:39.481846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:39.514209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6d618-86f1-48da-a6f8-74a3b531a67c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:39.551934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e369-0b49-4b88-86a3-46a45dd1a152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:39.552873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e369-0b49-4b88-86a3-46a45dd1a152 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.553411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e369-0b49-4b88-86a3-46a45dd1a152 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.553836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94e369-0b49-4b88-86a3-46a45dd1a152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.566103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94e369-0b49-4b88-86a3-46a45dd1a152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-9f94e369-0b49-4b88-86a3-46a45dd1a152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:39.573547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:39.574458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:39.575350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:39.577843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 34/69] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:39.578884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e369-0b49-4b88-86a3-46a45dd1a152 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:39.609017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe7c58-5f9b-414c-824e-2d34c01ffdee None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:39.649542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:39.650452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.650922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.651540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.652592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:39.653491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:39.656335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:39.671795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 36/70] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:39.673203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:39.704739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:39.705610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94e369-0b49-4b88-86a3-46a45dd1a152 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:39.735756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:39.745057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7bd2-8fb2-4168-a4bd-9767cd20a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:39.745840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7bd2-8fb2-4168-a4bd-9767cd20a7cb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.746193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7bd2-8fb2-4168-a4bd-9767cd20a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.746546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7bd2-8fb2-4168-a4bd-9767cd20a7cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.758541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec7bd2-8fb2-4168-a4bd-9767cd20a7cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-f1ec7bd2-8fb2-4168-a4bd-9767cd20a7cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:39.767131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:39.768037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:39.768792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 35/71] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:03:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:39.769765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7bd2-8fb2-4168-a4bd-9767cd20a7cb None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:39.803678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5700e-755d-4d25-98e6-3b65df81f376 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:39.847991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544053a8-c025-4380-b639-b9e0a4d8e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:39.848909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544053a8-c025-4380-b639-b9e0a4d8e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.849196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544053a8-c025-4380-b639-b9e0a4d8e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.849465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544053a8-c025-4380-b639-b9e0a4d8e0f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.850180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544053a8-c025-4380-b639-b9e0a4d8e0f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:39.850486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544053a8-c025-4380-b639-b9e0a4d8e0f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:39.852489 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544053a8-c025-4380-b639-b9e0a4d8e0f3 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:39.863331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 37/72] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:39.864609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4003b-3b7b-4388-871a-8b195a50dae5 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.864946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4003b-3b7b-4388-871a-8b195a50dae5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.865214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4003b-3b7b-4388-871a-8b195a50dae5 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.866449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 38/73] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:39.867225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4003b-3b7b-4388-871a-8b195a50dae5 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:39.897407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7bd2-8fb2-4168-a4bd-9767cd20a7cb None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:39.939564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c3fa0-066c-4a7f-a139-9aa60d0849b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:39.940212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c3fa0-066c-4a7f-a139-9aa60d0849b3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:39.940521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c3fa0-066c-4a7f-a139-9aa60d0849b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:39.940761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c3fa0-066c-4a7f-a139-9aa60d0849b3 None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:39.956020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c3fa0-066c-4a7f-a139-9aa60d0849b3 None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:39.957594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c3fa0-066c-4a7f-a139-9aa60d0849b3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:39.959406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 36/74] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:39 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:39.960180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c3fa0-066c-4a7f-a139-9aa60d0849b3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:39.969318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:39.988740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4003b-3b7b-4388-871a-8b195a50dae5 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:40.020392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:40.041774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482257-76e9-44b9-be7d-8e2f846c0657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:40.042640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482257-76e9-44b9-be7d-8e2f846c0657 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.042831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482257-76e9-44b9-be7d-8e2f846c0657 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.043459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482257-76e9-44b9-be7d-8e2f846c0657 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.044677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482257-76e9-44b9-be7d-8e2f846c0657 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:40.045064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482257-76e9-44b9-be7d-8e2f846c0657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:40.047538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482257-76e9-44b9-be7d-8e2f846c0657 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:40.058887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 39/75] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:03:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:40.060095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99e320-1512-4ed1-84f0-4f9bc7ad3cc6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.060384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99e320-1512-4ed1-84f0-4f9bc7ad3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.060667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99e320-1512-4ed1-84f0-4f9bc7ad3cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.080658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4d99e320-1512-4ed1-84f0-4f9bc7ad3cc6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:40.081908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4d99e320-1512-4ed1-84f0-4f9bc7ad3cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:40.093502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c3fa0-066c-4a7f-a139-9aa60d0849b3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:40.130624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140f8b9-e287-4cf6-9634-fe57d2cc3d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:40.131279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140f8b9-e287-4cf6-9634-fe57d2cc3d9e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.131559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140f8b9-e287-4cf6-9634-fe57d2cc3d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.131833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140f8b9-e287-4cf6-9634-fe57d2cc3d9e None admin] PATH_INFO: `/v3/users/0b3130018efa44a5a2048fca15b5c1f6` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.133082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140f8b9-e287-4cf6-9634-fe57d2cc3d9e None admin] RBAC: Authorizing `identity:get_user(user_id=0b3130018efa44a5a2048fca15b5c1f6)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:40.134550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140f8b9-e287-4cf6-9634-fe57d2cc3d9e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:40.136609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 37/76] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:39 2022] GET /identity/v3/users/0b3130018efa44a5a2048fca15b5c1f6 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:40.137410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140f8b9-e287-4cf6-9634-fe57d2cc3d9e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:40.157146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 40/77] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:40.161380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99e320-1512-4ed1-84f0-4f9bc7ad3cc6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:40.250910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140f8b9-e287-4cf6-9634-fe57d2cc3d9e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:40.258248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:40.266633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:40.284575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99e320-1512-4ed1-84f0-4f9bc7ad3cc6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:40.291809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7932f1-d09b-4730-9dc1-2a6f9294d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:40.292635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7932f1-d09b-4730-9dc1-2a6f9294d180 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.292949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7932f1-d09b-4730-9dc1-2a6f9294d180 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.293226 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7932f1-d09b-4730-9dc1-2a6f9294d180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.323643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be3570-0064-4dc2-8f72-9d285e08585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:40.324244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be3570-0064-4dc2-8f72-9d285e08585d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.324526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be3570-0064-4dc2-8f72-9d285e08585d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.324815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be3570-0064-4dc2-8f72-9d285e08585d None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.326782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be3570-0064-4dc2-8f72-9d285e08585d None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:40.328274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be3570-0064-4dc2-8f72-9d285e08585d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:40.329933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 41/78] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:40 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:40.331210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86d68-c40c-402b-886a-42c0a349f105 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.331501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86d68-c40c-402b-886a-42c0a349f105 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.331775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86d68-c40c-402b-886a-42c0a349f105 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.333527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 42/79] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:40.334533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b86d68-c40c-402b-886a-42c0a349f105 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:40.373136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7932f1-d09b-4730-9dc1-2a6f9294d180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:40.374668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7932f1-d09b-4730-9dc1-2a6f9294d180 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:40.461632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b86d68-c40c-402b-886a-42c0a349f105 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:40.503631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 38/80] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:40.505324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84ae10-66fb-4273-b36e-ff5a5db54a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:40.506186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84ae10-66fb-4273-b36e-ff5a5db54a47 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.506503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84ae10-66fb-4273-b36e-ff5a5db54a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.506721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7932f1-d09b-4730-9dc1-2a6f9294d180 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:40.506817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84ae10-66fb-4273-b36e-ff5a5db54a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.523241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:40.523434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:40.583334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84ae10-66fb-4273-b36e-ff5a5db54a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:40.584716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84ae10-66fb-4273-b36e-ff5a5db54a47 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:40.620315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7932f1-d09b-4730-9dc1-2a6f9294d180 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:40.656905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbc2e8-2448-4149-8edf-6b2d0e5cd094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:40.657722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc2e8-2448-4149-8edf-6b2d0e5cd094 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.657992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc2e8-2448-4149-8edf-6b2d0e5cd094 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.658268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc2e8-2448-4149-8edf-6b2d0e5cd094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.670200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbc2e8-2448-4149-8edf-6b2d0e5cd094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-5adbc2e8-2448-4149-8edf-6b2d0e5cd094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:40.675160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:40.676015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:40.676771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 39/81] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:40.677529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e6cb-7bae-407e-b428-41dc9ef6f41a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.677891 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e6cb-7bae-407e-b428-41dc9ef6f41a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.678150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e6cb-7bae-407e-b428-41dc9ef6f41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.696664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 43/82] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:40.696664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84ae10-66fb-4273-b36e-ff5a5db54a47 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:40.703618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-5de4e6cb-7bae-407e-b428-41dc9ef6f41a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:40.705271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5de4e6cb-7bae-407e-b428-41dc9ef6f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:40.742049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:40.778916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 40/83] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:40.779986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e6cb-7bae-407e-b428-41dc9ef6f41a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:40.787429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:40.815969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84ae10-66fb-4273-b36e-ff5a5db54a47 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:40.852330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8635c0-8a6f-4b6a-b49e-cd87a4188ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:40.852861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8635c0-8a6f-4b6a-b49e-cd87a4188ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.853296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8635c0-8a6f-4b6a-b49e-cd87a4188ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.853712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8635c0-8a6f-4b6a-b49e-cd87a4188ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.897321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e6cb-7bae-407e-b428-41dc9ef6f41a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:40.929290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8635c0-8a6f-4b6a-b49e-cd87a4188ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:40.930791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8635c0-8a6f-4b6a-b49e-cd87a4188ed4 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:40.934871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc82d9a-c931-4954-956b-0dcdf50ef605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:40.935520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82d9a-c931-4954-956b-0dcdf50ef605 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:40.935804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82d9a-c931-4954-956b-0dcdf50ef605 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:40.936084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82d9a-c931-4954-956b-0dcdf50ef605 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:40.937291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc82d9a-c931-4954-956b-0dcdf50ef605 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:40.938846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc82d9a-c931-4954-956b-0dcdf50ef605 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:40.940669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 41/84] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:40 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:40.941484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc82d9a-c931-4954-956b-0dcdf50ef605 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:40.980580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.023612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.041357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 44/85] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:41.042199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8635c0-8a6f-4b6a-b49e-cd87a4188ed4 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.057966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc82d9a-c931-4954-956b-0dcdf50ef605 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.093586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.094251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.094528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.094802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.095520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] RBAC: Adding query filter params (name=member) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:41.095820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.098233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.113991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 42/86] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:41.113991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.154438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8635c0-8a6f-4b6a-b49e-cd87a4188ed4 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.192013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0209-861b-452a-8dc3-8e910811afa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.192697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0209-861b-452a-8dc3-8e910811afa7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.193009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0209-861b-452a-8dc3-8e910811afa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.193286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0209-861b-452a-8dc3-8e910811afa7 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.194465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a0209-861b-452a-8dc3-8e910811afa7 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.196012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a0209-861b-452a-8dc3-8e910811afa7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.197930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 45/87] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:41 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:41.198755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0209-861b-452a-8dc3-8e910811afa7 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.214875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.221999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed1cb6-d9f4-4d97-80dc-038e586b652d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.261357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aab739-f734-4129-94ff-26fabb008927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.262006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aab739-f734-4129-94ff-26fabb008927 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.262287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aab739-f734-4129-94ff-26fabb008927 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.262559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aab739-f734-4129-94ff-26fabb008927 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.263831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aab739-f734-4129-94ff-26fabb008927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.265357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aab739-f734-4129-94ff-26fabb008927 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.266995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 43/88] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:41.269960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aab739-f734-4129-94ff-26fabb008927 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.273718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.313415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0209-861b-452a-8dc3-8e910811afa7 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.351757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.352411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.352662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.352953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.354486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] RBAC: Adding query filter params (role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=81c7e412e96f4fadaa334b907d4734e7, user.id=48881791ec6346f88994e2d0e77b45c5) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:41.354826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.356577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.365486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 46/89] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:41 2022] GET /identity/v3/role_assignments?user.id=48881791ec6346f88994e2d0e77b45c5&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:41.366295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.395606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aab739-f734-4129-94ff-26fabb008927 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.451315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35774561-308e-4b96-ae0d-b4bb8a8593fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.452041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774561-308e-4b96-ae0d-b4bb8a8593fd None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.452325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774561-308e-4b96-ae0d-b4bb8a8593fd None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.452600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774561-308e-4b96-ae0d-b4bb8a8593fd None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.454152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35774561-308e-4b96-ae0d-b4bb8a8593fd None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.455707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35774561-308e-4b96-ae0d-b4bb8a8593fd None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.457974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 44/90] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:41 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:41.458835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35774561-308e-4b96-ae0d-b4bb8a8593fd None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.511821 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.542794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58cac0-aa12-4465-bffe-53bdd084b1c9 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.592502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.600835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd4171-a572-46a0-995b-91443bbe6044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.601971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4171-a572-46a0-995b-91443bbe6044 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.602436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4171-a572-46a0-995b-91443bbe6044 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.602905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4171-a572-46a0-995b-91443bbe6044 None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.607300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd4171-a572-46a0-995b-91443bbe6044 None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.608336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd4171-a572-46a0-995b-91443bbe6044 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.618533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 47/91] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:41 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:41.618533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd4171-a572-46a0-995b-91443bbe6044 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.648803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35774561-308e-4b96-ae0d-b4bb8a8593fd None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.698116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.698772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.699057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.699332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.700234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=81c7e412e96f4fadaa334b907d4734e7, user.id=0b3130018efa44a5a2048fca15b5c1f6) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:41.700561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.702177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.709073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 45/92] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:41 2022] GET /identity/v3/role_assignments?user.id=0b3130018efa44a5a2048fca15b5c1f6&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:41.718084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.756540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd4171-a572-46a0-995b-91443bbe6044 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.807703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df848b-ad33-4a01-bebb-3e89fbb04d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.808389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df848b-ad33-4a01-bebb-3e89fbb04d9f None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.808699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df848b-ad33-4a01-bebb-3e89fbb04d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.809036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df848b-ad33-4a01-bebb-3e89fbb04d9f None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.809873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df848b-ad33-4a01-bebb-3e89fbb04d9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.811366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df848b-ad33-4a01-bebb-3e89fbb04d9f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.880411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7cb45-d4b2-4349-85ae-a9d5361ef61d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:41.917329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.933061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 48/93] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:03:41 2022] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:41.934712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df848b-ad33-4a01-bebb-3e89fbb04d9f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:41.939649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:41.940913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:41.941448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:41.942011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:41.943340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] RBAC: Adding query filter params (role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=81c7e412e96f4fadaa334b907d4734e7, user.id=48881791ec6346f88994e2d0e77b45c5) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:41.944012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:41.946153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:41.950606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:41.956103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 46/94] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:41 2022] GET /identity/v3/role_assignments?user.id=48881791ec6346f88994e2d0e77b45c5&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:42.157669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df848b-ad33-4a01-bebb-3e89fbb04d9f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:42.204954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2b3bb-5d4a-40e9-af01-8a97c08f9108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:42.205612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2b3bb-5d4a-40e9-af01-8a97c08f9108 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:42.205892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2b3bb-5d4a-40e9-af01-8a97c08f9108 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:42.206168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2b3bb-5d4a-40e9-af01-8a97c08f9108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:42.291633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:42.294658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2b3bb-5d4a-40e9-af01-8a97c08f9108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:42.296309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2b3bb-5d4a-40e9-af01-8a97c08f9108 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:42.410052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 49/95] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:42.416073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:42.549544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1827c-2932-4a5c-a8e4-7a0f0eb4892b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:42.591155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34505-a580-44e2-bb51-511fee3b1996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:42.591819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34505-a580-44e2-bb51-511fee3b1996 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:42.592102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34505-a580-44e2-bb51-511fee3b1996 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:42.592379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34505-a580-44e2-bb51-511fee3b1996 None admin] PATH_INFO: `/v3/projects/aaebcb92641c42129e588e29072c1631` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:42.593636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34505-a580-44e2-bb51-511fee3b1996 None admin] RBAC: Authorizing `identity:get_project(project_id=aaebcb92641c42129e588e29072c1631)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:42.595163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34505-a580-44e2-bb51-511fee3b1996 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:42.596927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 47/96] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:42 2022] GET /identity/v3/projects/aaebcb92641c42129e588e29072c1631 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:42.603863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2b3bb-5d4a-40e9-af01-8a97c08f9108 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:42.711611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:42.715412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2b3bb-5d4a-40e9-af01-8a97c08f9108 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:42.758764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64407b16-356f-4a13-b8da-73b66e83d8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:42.760143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64407b16-356f-4a13-b8da-73b66e83d8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:42.760585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64407b16-356f-4a13-b8da-73b66e83d8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:42.760861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64407b16-356f-4a13-b8da-73b66e83d8a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:42.761751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64407b16-356f-4a13-b8da-73b66e83d8a3 None admin] RBAC: Adding query filter params (role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=aaebcb92641c42129e588e29072c1631, user.id=48881791ec6346f88994e2d0e77b45c5) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:42.762043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64407b16-356f-4a13-b8da-73b66e83d8a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:42.763654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64407b16-356f-4a13-b8da-73b66e83d8a3 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:42.770049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 50/97] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:42 2022] GET /identity/v3/role_assignments?user.id=48881791ec6346f88994e2d0e77b45c5&scope.project.id=aaebcb92641c42129e588e29072c1631&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:44.224218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ca7f-9617-4850-8d82-d83293a3b1da None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:44.225263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ca7f-9617-4850-8d82-d83293a3b1da None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:44.225750 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408ca7f-9617-4850-8d82-d83293a3b1da None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:44.227603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 48/98] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:44.233440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a6263-8ac1-4b33-bfe0-016128f436d7 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:44.234327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a6263-8ac1-4b33-bfe0-016128f436d7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:44.234797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a6263-8ac1-4b33-bfe0-016128f436d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:44.262061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-733a6263-8ac1-4b33-bfe0-016128f436d7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:44.263608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-733a6263-8ac1-4b33-bfe0-016128f436d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:44.352177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 51/99] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:44.376207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d97ba-7e0c-4a34-80c7-8092ce414c05 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:44.377033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d97ba-7e0c-4a34-80c7-8092ce414c05 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:44.377707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d97ba-7e0c-4a34-80c7-8092ce414c05 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:44.380036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 49/100] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:44.387187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a6263-8ac1-4b33-bfe0-016128f436d7 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:44.394816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acc229-3278-462f-ab9c-ffb0ebdd330d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:44.395601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acc229-3278-462f-ab9c-ffb0ebdd330d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:44.396213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acc229-3278-462f-ab9c-ffb0ebdd330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:44.426847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-62acc229-3278-462f-ab9c-ffb0ebdd330d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:44.429426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-62acc229-3278-462f-ab9c-ffb0ebdd330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:44.553960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:44.579203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a6263-8ac1-4b33-bfe0-016128f436d7 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:44.589494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:44.601564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 50/101] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:44.634862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a192-6f05-4e8b-88ae-b13bd755cf00 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:44.635259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a192-6f05-4e8b-88ae-b13bd755cf00 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:44.635497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a192-6f05-4e8b-88ae-b13bd755cf00 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:44.637148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 51/102] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:03:44.643466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a0ec3-019e-4352-9bc7-52bcd550fb95 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:44.643755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a0ec3-019e-4352-9bc7-52bcd550fb95 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:44.644034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a0ec3-019e-4352-9bc7-52bcd550fb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:44.667797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b31737-1205-4e1e-930c-8c4e22322f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:44.668471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31737-1205-4e1e-930c-8c4e22322f3b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:44.668751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31737-1205-4e1e-930c-8c4e22322f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:44.669305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31737-1205-4e1e-930c-8c4e22322f3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:44.680747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3e4a0ec3-019e-4352-9bc7-52bcd550fb95 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:44.685530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3e4a0ec3-019e-4352-9bc7-52bcd550fb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:44.701116 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b31737-1205-4e1e-930c-8c4e22322f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-e2b31737-1205-4e1e-930c-8c4e22322f3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:44.708424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:44.709288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:44.710046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 52/103] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:44.710655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b31737-1205-4e1e-930c-8c4e22322f3b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:44.834699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 52/104] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:44.835957 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a0ec3-019e-4352-9bc7-52bcd550fb95 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:44.949653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a0ec3-019e-4352-9bc7-52bcd550fb95 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:44.964173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b31737-1205-4e1e-930c-8c4e22322f3b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:44.989280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:44.998044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:44.999000 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:44.999502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:44.999965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.000874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:45.001398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:45.003330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:45.021895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 53/105] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:45.022743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:45.050109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bc8a7-40a2-441d-b1b9-7d87931da6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:45.050754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc8a7-40a2-441d-b1b9-7d87931da6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.051137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc8a7-40a2-441d-b1b9-7d87931da6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.051455 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc8a7-40a2-441d-b1b9-7d87931da6d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.070759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bc8a7-40a2-441d-b1b9-7d87931da6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-280bc8a7-40a2-441d-b1b9-7d87931da6d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:45.076451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:45.077432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:45.078180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 53/106] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:45.078805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bc8a7-40a2-441d-b1b9-7d87931da6d3 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:45.096741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:45.234795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bc8a7-40a2-441d-b1b9-7d87931da6d3 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:45.238776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2939b9-ef7e-411a-94c1-b13af035c8cb None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:45.289046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d6f6-05cd-494a-9116-97e042c7a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:45.289915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d6f6-05cd-494a-9116-97e042c7a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.290290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d6f6-05cd-494a-9116-97e042c7a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.290609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d6f6-05cd-494a-9116-97e042c7a7a4 None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.292179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8d6f6-05cd-494a-9116-97e042c7a7a4 None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:45.293770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8d6f6-05cd-494a-9116-97e042c7a7a4 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:45.295853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 54/107] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:45 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:45.296640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d6f6-05cd-494a-9116-97e042c7a7a4 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:45.320749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb247eec-8c1f-4570-a03d-4a30ad2adaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:45.321492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247eec-8c1f-4570-a03d-4a30ad2adaaa None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.322270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247eec-8c1f-4570-a03d-4a30ad2adaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.322552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247eec-8c1f-4570-a03d-4a30ad2adaaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb247eec-8c1f-4570-a03d-4a30ad2adaaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-cb247eec-8c1f-4570-a03d-4a30ad2adaaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:45.368538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:45.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:45.370925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 54/108] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:03:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:45.372511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb247eec-8c1f-4570-a03d-4a30ad2adaaa None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:45.473592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:45.496524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:45.510894 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d6f6-05cd-494a-9116-97e042c7a7a4 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:45.582279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:45.582930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.583211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.583486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.584212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:45.584514 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:45.590198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb247eec-8c1f-4570-a03d-4a30ad2adaaa None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:45.590642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:45.607543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 55/109] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:45.612818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:45.658627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a20b1-8a4b-4d2b-8462-abc4e441e668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:45.659222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a20b1-8a4b-4d2b-8462-abc4e441e668 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.659502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a20b1-8a4b-4d2b-8462-abc4e441e668 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.659810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a20b1-8a4b-4d2b-8462-abc4e441e668 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.664178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a20b1-8a4b-4d2b-8462-abc4e441e668 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:45.666313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a20b1-8a4b-4d2b-8462-abc4e441e668 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:45.668327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 55/110] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:45 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:45.673370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a20b1-8a4b-4d2b-8462-abc4e441e668 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:45.784336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ffa0-3049-487b-a53b-dacd13ada5fd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:45.830070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:45.830841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.831126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.831396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.832292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:45.832579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:45.834008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:45.839134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a20b1-8a4b-4d2b-8462-abc4e441e668 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:45.844798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 56/111] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:03:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:45.845686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:45.858323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:45.863397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:45.885768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c937c-931a-4728-af29-8094a1656029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:45.886527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c937c-931a-4728-af29-8094a1656029 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.886835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c937c-931a-4728-af29-8094a1656029 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.887162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c937c-931a-4728-af29-8094a1656029 None admin] PATH_INFO: `/v3/users/0b3130018efa44a5a2048fca15b5c1f6` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.888619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c937c-931a-4728-af29-8094a1656029 None admin] RBAC: Authorizing `identity:get_user(user_id=0b3130018efa44a5a2048fca15b5c1f6)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:45.890186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c937c-931a-4728-af29-8094a1656029 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:45.892126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 56/112] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:45 2022] GET /identity/v3/users/0b3130018efa44a5a2048fca15b5c1f6 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:45.893400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ab6ad-cfe7-4671-a273-6884de6b44ce None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.893687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ab6ad-cfe7-4671-a273-6884de6b44ce None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.893963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ab6ad-cfe7-4671-a273-6884de6b44ce None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.895239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 57/113] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:45.896591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4152a-2cb4-48e2-a69d-6208ba389de1 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:45.896900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4152a-2cb4-48e2-a69d-6208ba389de1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:45.897178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4152a-2cb4-48e2-a69d-6208ba389de1 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:45.902727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 58/114] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:45.902727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4152a-2cb4-48e2-a69d-6208ba389de1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:45.975412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509609-a141-40be-951e-2fdc50869dfa None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:46.015802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802eba21-b343-4cdb-80e5-afb927d00cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:46.016487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eba21-b343-4cdb-80e5-afb927d00cbd None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.016769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eba21-b343-4cdb-80e5-afb927d00cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.017083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eba21-b343-4cdb-80e5-afb927d00cbd None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7/users/48881791ec6346f88994e2d0e77b45c5/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.019101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802eba21-b343-4cdb-80e5-afb927d00cbd None admin] RBAC: Authorizing `identity:create_grant(project_id=81c7e412e96f4fadaa334b907d4734e7, user_id=48881791ec6346f88994e2d0e77b45c5, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:46.020619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802eba21-b343-4cdb-80e5-afb927d00cbd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:46.029977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4152a-2cb4-48e2-a69d-6208ba389de1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:46.065815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717788ca-bd35-4bbb-966a-faa038dd4785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:46.066468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717788ca-bd35-4bbb-966a-faa038dd4785 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.066753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717788ca-bd35-4bbb-966a-faa038dd4785 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.067033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717788ca-bd35-4bbb-966a-faa038dd4785 None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.068196 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717788ca-bd35-4bbb-966a-faa038dd4785 None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:46.069726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717788ca-bd35-4bbb-966a-faa038dd4785 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:46.071340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 59/115] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:45 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:46.072316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717788ca-bd35-4bbb-966a-faa038dd4785 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:46.114719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 57/116] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:03:45 2022] PUT /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7/users/48881791ec6346f88994e2d0e77b45c5/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:46.115915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba591-a2a4-4dc1-83c7-a8fa2592f49a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.116200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba591-a2a4-4dc1-83c7-a8fa2592f49a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.116483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeba591-a2a4-4dc1-83c7-a8fa2592f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.133132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:46.143456 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0aeba591-a2a4-4dc1-83c7-a8fa2592f49a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:46.145197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0aeba591-a2a4-4dc1-83c7-a8fa2592f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:46.198418 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717788ca-bd35-4bbb-966a-faa038dd4785 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:46.221865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:46.236839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 58/117] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:46.236839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf656-4967-4880-99f6-4e69b4fa4ad2 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.236839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf656-4967-4880-99f6-4e69b4fa4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.236839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf656-4967-4880-99f6-4e69b4fa4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.257544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-80dbf656-4967-4880-99f6-4e69b4fa4ad2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:46.259267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-80dbf656-4967-4880-99f6-4e69b4fa4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:46.259533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6609207-224f-4425-b0c9-8cfd260e2135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:46.260116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6609207-224f-4425-b0c9-8cfd260e2135 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.260422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6609207-224f-4425-b0c9-8cfd260e2135 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.260526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6609207-224f-4425-b0c9-8cfd260e2135 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.262133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6609207-224f-4425-b0c9-8cfd260e2135 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:46.272391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6609207-224f-4425-b0c9-8cfd260e2135 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:46.272391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 60/118] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:46 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:46.272391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224280a2-7a39-43a7-a043-eccb9d948e4f None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.272391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224280a2-7a39-43a7-a043-eccb9d948e4f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.272391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224280a2-7a39-43a7-a043-eccb9d948e4f None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.272391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 61/119] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:46.272962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224280a2-7a39-43a7-a043-eccb9d948e4f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:46.349600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 59/120] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:46.350356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbf656-4967-4880-99f6-4e69b4fa4ad2 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:46.399159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224280a2-7a39-43a7-a043-eccb9d948e4f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:46.423827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:46.439966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b884c-12fb-4640-b86f-f7381048a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:46.447762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b884c-12fb-4640-b86f-f7381048a386 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.447762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b884c-12fb-4640-b86f-f7381048a386 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.447762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b884c-12fb-4640-b86f-f7381048a386 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.447762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b884c-12fb-4640-b86f-f7381048a386 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:46.447762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b884c-12fb-4640-b86f-f7381048a386 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:46.447762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 62/121] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:46 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:46.448318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b884c-12fb-4640-b86f-f7381048a386 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:46.546710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbf656-4967-4880-99f6-4e69b4fa4ad2 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:46.575310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b884c-12fb-4640-b86f-f7381048a386 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:46.576939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:46.587771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e52a4-e114-4617-a8f1-b2e3b90fc7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:46.589061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e52a4-e114-4617-a8f1-b2e3b90fc7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.589398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e52a4-e114-4617-a8f1-b2e3b90fc7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.589671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e52a4-e114-4617-a8f1-b2e3b90fc7f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.590907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e52a4-e114-4617-a8f1-b2e3b90fc7f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:46.592367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e52a4-e114-4617-a8f1-b2e3b90fc7f0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:46.594143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 60/122] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:46.599341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085b97f-6c41-42e5-b6e5-9b885602a5eb None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.599341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085b97f-6c41-42e5-b6e5-9b885602a5eb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.599341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085b97f-6c41-42e5-b6e5-9b885602a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.616174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b085b97f-6c41-42e5-b6e5-9b885602a5eb None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:46.618173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b085b97f-6c41-42e5-b6e5-9b885602a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:46.625347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79fce5-a08f-4f4e-bd91-8eb7c2119662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:46.626094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fce5-a08f-4f4e-bd91-8eb7c2119662 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.626443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fce5-a08f-4f4e-bd91-8eb7c2119662 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.627121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79fce5-a08f-4f4e-bd91-8eb7c2119662 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7/users/0b3130018efa44a5a2048fca15b5c1f6/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.629064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79fce5-a08f-4f4e-bd91-8eb7c2119662 None admin] RBAC: Authorizing `identity:create_grant(project_id=81c7e412e96f4fadaa334b907d4734e7, user_id=0b3130018efa44a5a2048fca15b5c1f6, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:46.630377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79fce5-a08f-4f4e-bd91-8eb7c2119662 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:46.693765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 61/123] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:46.694947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085b97f-6c41-42e5-b6e5-9b885602a5eb None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:46.774399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 63/124] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:03:46 2022] PUT /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7/users/0b3130018efa44a5a2048fca15b5c1f6/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:46.776681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79fce5-a08f-4f4e-bd91-8eb7c2119662 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:46.852306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:46.862083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085b97f-6c41-42e5-b6e5-9b885602a5eb None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:46.920251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79fce5-a08f-4f4e-bd91-8eb7c2119662 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:46.923923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:46.940361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75ca6-0d7a-47ca-9a60-b172c2b690dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:46.941600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75ca6-0d7a-47ca-9a60-b172c2b690dd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.941600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75ca6-0d7a-47ca-9a60-b172c2b690dd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.941851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75ca6-0d7a-47ca-9a60-b172c2b690dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.957130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a75ca6-0d7a-47ca-9a60-b172c2b690dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-38a75ca6-0d7a-47ca-9a60-b172c2b690dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:46.964733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:46.965740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:46.966523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 62/125] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:46.967193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75ca6-0d7a-47ca-9a60-b172c2b690dd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:46.973551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e224ef-0753-4af1-af09-ddbc27b67547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:46.974634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e224ef-0753-4af1-af09-ddbc27b67547 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:46.975201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e224ef-0753-4af1-af09-ddbc27b67547 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:46.975716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e224ef-0753-4af1-af09-ddbc27b67547 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7/users/48881791ec6346f88994e2d0e77b45c5/roles/59b4966b7b764eb5bc24547e4faef790` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:46.978706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e224ef-0753-4af1-af09-ddbc27b67547 None admin] RBAC: Authorizing `identity:create_grant(project_id=81c7e412e96f4fadaa334b907d4734e7, user_id=48881791ec6346f88994e2d0e77b45c5, role_id=59b4966b7b764eb5bc24547e4faef790)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:46.980959 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e224ef-0753-4af1-af09-ddbc27b67547 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:47.072743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 64/126] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:03:46 2022] PUT /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7/users/48881791ec6346f88994e2d0e77b45c5/roles/59b4966b7b764eb5bc24547e4faef790 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:47.074580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e224ef-0753-4af1-af09-ddbc27b67547 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:47.095219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75ca6-0d7a-47ca-9a60-b172c2b690dd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:47.138906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bc8ba-e90c-4d5d-b0c5-a59db4f95be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:47.139746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bc8ba-e90c-4d5d-b0c5-a59db4f95be8 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:47.140109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bc8ba-e90c-4d5d-b0c5-a59db4f95be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:47.140479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bc8ba-e90c-4d5d-b0c5-a59db4f95be8 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:47.141251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bc8ba-e90c-4d5d-b0c5-a59db4f95be8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:47.142815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bc8ba-e90c-4d5d-b0c5-a59db4f95be8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:47.217298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e224ef-0753-4af1-af09-ddbc27b67547 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:47.229168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:47.261912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a78dc-a5c0-4eb0-afb0-9e5e4c0df178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:47.263611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a78dc-a5c0-4eb0-afb0-9e5e4c0df178 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:47.264224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a78dc-a5c0-4eb0-afb0-9e5e4c0df178 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:47.264663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a78dc-a5c0-4eb0-afb0-9e5e4c0df178 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:47.270295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 63/127] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:03:46 2022] POST /identity/v3/projects => generated 302 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:47.276607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bc8ba-e90c-4d5d-b0c5-a59db4f95be8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:47.280327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a78dc-a5c0-4eb0-afb0-9e5e4c0df178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-4a9a78dc-a5c0-4eb0-afb0-9e5e4c0df178 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:47.286110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:47.287027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:03:47.287806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:47.290487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 65/128] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:47.299707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a78dc-a5c0-4eb0-afb0-9e5e4c0df178 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:47.347807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:47.492368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a78dc-a5c0-4eb0-afb0-9e5e4c0df178 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:47.515886 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bc8ba-e90c-4d5d-b0c5-a59db4f95be8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:47.534695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:47.535741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:47.536616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:47.537163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:47.538118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:47.538770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:47.540785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:47.555885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 66/129] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:47.562108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:47.566680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:47.568226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:47.568226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:47.568226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:47.569162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:47.569564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:47.571112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:47.581012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 64/130] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:47.589960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:47.617246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:47.764950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:47.772231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301b27-3f73-43cc-aeb0-b38671429fde None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:47.789012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87bb3a-84fb-4bc6-85c9-d17f69de3517 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:47.833330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd33b8-7aa8-4111-9baa-86d8c51f5402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:47.834371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd33b8-7aa8-4111-9baa-86d8c51f5402 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:47.834849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd33b8-7aa8-4111-9baa-86d8c51f5402 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:47.835750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd33b8-7aa8-4111-9baa-86d8c51f5402 None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:47.838672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd33b8-7aa8-4111-9baa-86d8c51f5402 None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:47.840429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd33b8-7aa8-4111-9baa-86d8c51f5402 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:47.842790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 65/131] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:47 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:47.848615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd33b8-7aa8-4111-9baa-86d8c51f5402 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:47.870007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b106-23a1-4a59-9540-b2f58e7b67a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:47.870586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b106-23a1-4a59-9540-b2f58e7b67a2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:47.870871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b106-23a1-4a59-9540-b2f58e7b67a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:47.871143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b106-23a1-4a59-9540-b2f58e7b67a2 None admin] PATH_INFO: `/v3/users/f1d2b9f62b2a4aa59a32268fcd232ee6` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:47.904595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94b106-23a1-4a59-9540-b2f58e7b67a2 None admin] RBAC: Authorizing `identity:get_user(user_id=f1d2b9f62b2a4aa59a32268fcd232ee6)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:47.908524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94b106-23a1-4a59-9540-b2f58e7b67a2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:47.910644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 67/132] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:47 2022] GET /identity/v3/users/f1d2b9f62b2a4aa59a32268fcd232ee6 => generated 289 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:47.916707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b106-23a1-4a59-9540-b2f58e7b67a2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:48.041364 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd33b8-7aa8-4111-9baa-86d8c51f5402 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:48.107154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd06de-812e-44b2-a80f-23f4fcb79857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:48.108194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd06de-812e-44b2-a80f-23f4fcb79857 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:48.108733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd06de-812e-44b2-a80f-23f4fcb79857 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:48.109452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd06de-812e-44b2-a80f-23f4fcb79857 None admin] PATH_INFO: `/v3/projects/aaebcb92641c42129e588e29072c1631` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:48.113741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd06de-812e-44b2-a80f-23f4fcb79857 None admin] RBAC: Authorizing `identity:get_project(project_id=aaebcb92641c42129e588e29072c1631)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:48.116236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd06de-812e-44b2-a80f-23f4fcb79857 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:48.119597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 66/133] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:47 2022] GET /identity/v3/projects/aaebcb92641c42129e588e29072c1631 => generated 312 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:48.124947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd06de-812e-44b2-a80f-23f4fcb79857 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:48.157239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:48.180706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b106-23a1-4a59-9540-b2f58e7b67a2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:48.192443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:48.273735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece6f6-11ff-4518-9567-ad7c62dcc854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:48.274434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece6f6-11ff-4518-9567-ad7c62dcc854 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:48.274700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece6f6-11ff-4518-9567-ad7c62dcc854 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:48.275775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece6f6-11ff-4518-9567-ad7c62dcc854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:48.276459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd06de-812e-44b2-a80f-23f4fcb79857 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:48.323992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53641b1-aa4e-43e3-b06d-e7c792652a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:48.325148 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53641b1-aa4e-43e3-b06d-e7c792652a34 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:48.326229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53641b1-aa4e-43e3-b06d-e7c792652a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:48.326713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53641b1-aa4e-43e3-b06d-e7c792652a34 None admin] PATH_INFO: `/v3/projects/aaebcb92641c42129e588e29072c1631/users/48881791ec6346f88994e2d0e77b45c5/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:48.329337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53641b1-aa4e-43e3-b06d-e7c792652a34 None admin] RBAC: Authorizing `identity:create_grant(project_id=aaebcb92641c42129e588e29072c1631, user_id=48881791ec6346f88994e2d0e77b45c5, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:48.331082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53641b1-aa4e-43e3-b06d-e7c792652a34 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:48.393703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdece6f6-11ff-4518-9567-ad7c62dcc854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:48.395607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdece6f6-11ff-4518-9567-ad7c62dcc854 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:48.418456 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 67/134] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:03:48 2022] PUT /identity/v3/projects/aaebcb92641c42129e588e29072c1631/users/48881791ec6346f88994e2d0e77b45c5/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:03:48.510701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:48.526546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 68/135] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:48.532775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53641b1-aa4e-43e3-b06d-e7c792652a34 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:48.605758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24260fa4-d7ce-4f5c-882d-3b46532f0a0e None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:48.606079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24260fa4-d7ce-4f5c-882d-3b46532f0a0e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:48.606324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24260fa4-d7ce-4f5c-882d-3b46532f0a0e None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:48.607801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 69/136] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:48.626430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dded6-9752-434c-8e7f-f6d330f14dcc None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:48.626759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dded6-9752-434c-8e7f-f6d330f14dcc None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:48.626982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dded6-9752-434c-8e7f-f6d330f14dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:48.662348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-209dded6-9752-434c-8e7f-f6d330f14dcc None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:48.663543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-209dded6-9752-434c-8e7f-f6d330f14dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:48.708979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:48.718243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53641b1-aa4e-43e3-b06d-e7c792652a34 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:48.771129 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef839b-1958-4edf-b918-02edaddde279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:48.772126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef839b-1958-4edf-b918-02edaddde279 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:48.772599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef839b-1958-4edf-b918-02edaddde279 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:48.773128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef839b-1958-4edf-b918-02edaddde279 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:48.776564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 70/137] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:48.777118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef839b-1958-4edf-b918-02edaddde279 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:48.778786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef839b-1958-4edf-b918-02edaddde279 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:48.780708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 68/138] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:48 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:48.786852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dded6-9752-434c-8e7f-f6d330f14dcc None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:48.808974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef839b-1958-4edf-b918-02edaddde279 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:48.969289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dded6-9752-434c-8e7f-f6d330f14dcc None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:48.987151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef839b-1958-4edf-b918-02edaddde279 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:49.007192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:49.016996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:49.018031 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:49.025421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:49.025421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:49.025421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] RBAC: Adding query filter params (role.id=77e9c604ddbf4af1ab9adf2ad12a4c46, scope.project.id=81c7e412e96f4fadaa334b907d4734e7, user.id=f1d2b9f62b2a4aa59a32268fcd232ee6) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:49.025421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:49.027397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:49.037768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 71/139] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:48 2022] GET /identity/v3/role_assignments?user.id=f1d2b9f62b2a4aa59a32268fcd232ee6&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:49.077110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3647b4-f5fd-49d2-a7e2-fd430d5cb022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:49.077792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3647b4-f5fd-49d2-a7e2-fd430d5cb022 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:49.078085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3647b4-f5fd-49d2-a7e2-fd430d5cb022 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:49.078398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3647b4-f5fd-49d2-a7e2-fd430d5cb022 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:49.103506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3647b4-f5fd-49d2-a7e2-fd430d5cb022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-ea3647b4-f5fd-49d2-a7e2-fd430d5cb022 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:49.108761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:49.109634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:49.110385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 69/140] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:03:49.116176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:49.269211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe859d-caea-442a-991d-81d9f7bc57c0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:49.312660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:49.313407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:49.313614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:49.313892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:49.318416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] RBAC: Adding query filter params (name=member) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:49.318416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:49.318416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:49.331404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 72/141] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:49.338031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3647b4-f5fd-49d2-a7e2-fd430d5cb022 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:49.388342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:49.506369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3647b4-f5fd-49d2-a7e2-fd430d5cb022 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:49.566569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a9823-2617-4ae7-9697-0c03f511ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:49.567238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9823-2617-4ae7-9697-0c03f511ca4e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:49.567525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9823-2617-4ae7-9697-0c03f511ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:49.567806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9823-2617-4ae7-9697-0c03f511ca4e None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:49.569123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a9823-2617-4ae7-9697-0c03f511ca4e None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:49.570639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a9823-2617-4ae7-9697-0c03f511ca4e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:49.574097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 70/142] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:49 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:49.578975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:49.654684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:49.739488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4feac-687f-49bc-a799-ec0a51aeb110 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:49.792244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c752-b76d-48e9-988b-5f2fa986c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:49.792916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c752-b76d-48e9-988b-5f2fa986c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:49.793199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c752-b76d-48e9-988b-5f2fa986c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:49.793472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c752-b76d-48e9-988b-5f2fa986c3c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:49.881283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17c752-b76d-48e9-988b-5f2fa986c3c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:49.882677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17c752-b76d-48e9-988b-5f2fa986c3c6 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:49.933029 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:49.990737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 73/143] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:49.997203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a9823-2617-4ae7-9697-0c03f511ca4e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:50.094520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:50.105436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a9823-2617-4ae7-9697-0c03f511ca4e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:50.142170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040e2d0-e275-4b2f-be8b-f306b74bbeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:50.142736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040e2d0-e275-4b2f-be8b-f306b74bbeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.143024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040e2d0-e275-4b2f-be8b-f306b74bbeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.143302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040e2d0-e275-4b2f-be8b-f306b74bbeb2 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.144493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040e2d0-e275-4b2f-be8b-f306b74bbeb2 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:50.151052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040e2d0-e275-4b2f-be8b-f306b74bbeb2 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:50.153139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 71/144] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:49 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:50.159009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c752-b76d-48e9-988b-5f2fa986c3c6 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:50.302792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c752-b76d-48e9-988b-5f2fa986c3c6 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:50.351699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709597c-e7b7-42ac-b0f5-3ece46116774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:50.352316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709597c-e7b7-42ac-b0f5-3ece46116774 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.352590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709597c-e7b7-42ac-b0f5-3ece46116774 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.353564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709597c-e7b7-42ac-b0f5-3ece46116774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.354705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709597c-e7b7-42ac-b0f5-3ece46116774 None admin] RBAC: Adding query filter params (role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=81c7e412e96f4fadaa334b907d4734e7, user.id=48881791ec6346f88994e2d0e77b45c5) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:50.355016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709597c-e7b7-42ac-b0f5-3ece46116774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:50.356496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709597c-e7b7-42ac-b0f5-3ece46116774 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:50.365053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 74/145] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:50 2022] GET /identity/v3/role_assignments?user.id=48881791ec6346f88994e2d0e77b45c5&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:50.463305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967bb1-a3cd-4bcf-b3c6-f38f35b4c161 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.464399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967bb1-a3cd-4bcf-b3c6-f38f35b4c161 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.464870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967bb1-a3cd-4bcf-b3c6-f38f35b4c161 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.466505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 72/146] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:50.472411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589aa8f-1512-4a17-bc84-19a594eee20d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.473063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589aa8f-1512-4a17-bc84-19a594eee20d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.473538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589aa8f-1512-4a17-bc84-19a594eee20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.504918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-8589aa8f-1512-4a17-bc84-19a594eee20d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:50.506427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8589aa8f-1512-4a17-bc84-19a594eee20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:50.508937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:50.519467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7468-137f-40ff-a69a-e140bd52a98d None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.519783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7468-137f-40ff-a69a-e140bd52a98d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.520011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7468-137f-40ff-a69a-e140bd52a98d None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.521577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 73/147] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:50.530748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048cb9e-4724-434e-a9cd-96dbfbd55045 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.531084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048cb9e-4724-434e-a9cd-96dbfbd55045 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.531281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048cb9e-4724-434e-a9cd-96dbfbd55045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.560254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-5048cb9e-4724-434e-a9cd-96dbfbd55045 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:50.561511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5048cb9e-4724-434e-a9cd-96dbfbd55045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:50.632698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 75/148] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:50.635065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38c664-2b59-4dc9-bba8-90570d20fef7 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.635349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38c664-2b59-4dc9-bba8-90570d20fef7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.635623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38c664-2b59-4dc9-bba8-90570d20fef7 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.637136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 76/149] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:50.646619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605fd3-ea84-461f-906d-307a70425f6f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.646882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605fd3-ea84-461f-906d-307a70425f6f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.647088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605fd3-ea84-461f-906d-307a70425f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.667107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 74/150] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:50.668289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048cb9e-4724-434e-a9cd-96dbfbd55045 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:50.682699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-7b605fd3-ea84-461f-906d-307a70425f6f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:50.684076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7b605fd3-ea84-461f-906d-307a70425f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:50.792500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:50.809242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048cb9e-4724-434e-a9cd-96dbfbd55045 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:50.813436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 77/151] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:50.819911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605fd3-ea84-461f-906d-307a70425f6f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:50.860633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f602f2-55da-4227-9b2b-dfcf4367e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:50.861682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f602f2-55da-4227-9b2b-dfcf4367e6df None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.862155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f602f2-55da-4227-9b2b-dfcf4367e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.862615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f602f2-55da-4227-9b2b-dfcf4367e6df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:50.875130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f602f2-55da-4227-9b2b-dfcf4367e6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-98f602f2-55da-4227-9b2b-dfcf4367e6df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:50.880768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:50.881672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:50.882437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:50.885395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 75/152] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:50.886609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f602f2-55da-4227-9b2b-dfcf4367e6df None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:50.908312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:50.948674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605fd3-ea84-461f-906d-307a70425f6f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:50.987149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a8647-dc6d-4064-bf4b-d85cef9d8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:50.987806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a8647-dc6d-4064-bf4b-d85cef9d8efe None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:50.988089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a8647-dc6d-4064-bf4b-d85cef9d8efe None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:50.988366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a8647-dc6d-4064-bf4b-d85cef9d8efe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.000449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a8647-dc6d-4064-bf4b-d85cef9d8efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:51.003948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f602f2-55da-4227-9b2b-dfcf4367e6df None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-be9a8647-dc6d-4064-bf4b-d85cef9d8efe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:51.005702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:51.006745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:03:51.007594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:51.012967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 78/153] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:03:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:51.013894 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a8647-dc6d-4064-bf4b-d85cef9d8efe None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.046486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd961ee3-e9c2-4d5e-b511-83872de245c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.047577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd961ee3-e9c2-4d5e-b511-83872de245c4 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.048053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd961ee3-e9c2-4d5e-b511-83872de245c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.048516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd961ee3-e9c2-4d5e-b511-83872de245c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.050004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd961ee3-e9c2-4d5e-b511-83872de245c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.051661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd961ee3-e9c2-4d5e-b511-83872de245c4 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.053502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 76/154] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:51.057688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd961ee3-e9c2-4d5e-b511-83872de245c4 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.082004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:51.129140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a8647-dc6d-4064-bf4b-d85cef9d8efe None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.169606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:51.175123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.175755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.176032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.176306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.176836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd961ee3-e9c2-4d5e-b511-83872de245c4 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.177061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:51.177366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.179011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.189977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 79/155] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:51.200686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.222558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.223120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.223399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.223671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.224448 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:51.224691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.226124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.235725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 77/156] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:03:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:51.236566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.311597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90168-f664-42ec-8c97-727d29259d2d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.327323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:51.344370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cd412-ca00-4b65-ad39-8fba6fc60717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.345390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd412-ca00-4b65-ad39-8fba6fc60717 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.345887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd412-ca00-4b65-ad39-8fba6fc60717 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.346347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd412-ca00-4b65-ad39-8fba6fc60717 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.351775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cd412-ca00-4b65-ad39-8fba6fc60717 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.351775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cd412-ca00-4b65-ad39-8fba6fc60717 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.352419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a378160-88c5-4001-815e-a4797bde30a6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.388993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc55c-aea5-432f-b669-abf75e9b1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.389716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc55c-aea5-432f-b669-abf75e9b1b5b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.389998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc55c-aea5-432f-b669-abf75e9b1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.390269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc55c-aea5-432f-b669-abf75e9b1b5b None admin] PATH_INFO: `/v3/users/0b3130018efa44a5a2048fca15b5c1f6` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.391519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fc55c-aea5-432f-b669-abf75e9b1b5b None admin] RBAC: Authorizing `identity:get_user(user_id=0b3130018efa44a5a2048fca15b5c1f6)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.394133 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fc55c-aea5-432f-b669-abf75e9b1b5b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.395919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 78/157] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:51 2022] GET /identity/v3/users/0b3130018efa44a5a2048fca15b5c1f6 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:51.396517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc55c-aea5-432f-b669-abf75e9b1b5b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.505430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 80/158] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:03:51 2022] POST /identity/v3/users => generated 283 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:51.506670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cd412-ca00-4b65-ad39-8fba6fc60717 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.535976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc55c-aea5-432f-b669-abf75e9b1b5b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.577012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:51.597767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656bdb6-0c9b-4fda-be01-79fd14bb6a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.598828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656bdb6-0c9b-4fda-be01-79fd14bb6a9e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.599304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656bdb6-0c9b-4fda-be01-79fd14bb6a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.599771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656bdb6-0c9b-4fda-be01-79fd14bb6a9e None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.602177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656bdb6-0c9b-4fda-be01-79fd14bb6a9e None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.605366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656bdb6-0c9b-4fda-be01-79fd14bb6a9e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.608851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 79/159] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:51 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:51.610517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235151-6d9f-461a-9976-e3b3ce447723 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.611001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235151-6d9f-461a-9976-e3b3ce447723 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.611460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69235151-6d9f-461a-9976-e3b3ce447723 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.614427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 80/160] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:51.615695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235151-6d9f-461a-9976-e3b3ce447723 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.639342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:51.652734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cd412-ca00-4b65-ad39-8fba6fc60717 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.700389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a80d9d-0fbb-46b8-8bf8-1ed3774c0044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.701494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a80d9d-0fbb-46b8-8bf8-1ed3774c0044 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.701999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a80d9d-0fbb-46b8-8bf8-1ed3774c0044 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.702476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a80d9d-0fbb-46b8-8bf8-1ed3774c0044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.754793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69235151-6d9f-461a-9976-e3b3ce447723 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.801390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a80d9d-0fbb-46b8-8bf8-1ed3774c0044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.803350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a80d9d-0fbb-46b8-8bf8-1ed3774c0044 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.809873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8245db-a2ed-4bfc-b681-be57f22717bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.810784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8245db-a2ed-4bfc-b681-be57f22717bd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.811233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8245db-a2ed-4bfc-b681-be57f22717bd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.811671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8245db-a2ed-4bfc-b681-be57f22717bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.865449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:51.917763 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8245db-a2ed-4bfc-b681-be57f22717bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.920017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8245db-a2ed-4bfc-b681-be57f22717bd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.943439 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:51.943905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 81/161] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:51.945464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba23a3-b9de-40c7-8985-f551e1506825 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.945759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba23a3-b9de-40c7-8985-f551e1506825 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.946031 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba23a3-b9de-40c7-8985-f551e1506825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.966380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-49ba23a3-b9de-40c7-8985-f551e1506825 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:51.968188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-49ba23a3-b9de-40c7-8985-f551e1506825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:52.056671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 81/162] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:52.058732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaa9c-66ed-47b0-85a2-47c37808843d None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.059984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaa9c-66ed-47b0-85a2-47c37808843d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.060417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaa9c-66ed-47b0-85a2-47c37808843d None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:52.060689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 82/163] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:52.061735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba23a3-b9de-40c7-8985-f551e1506825 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:52.062239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 82/164] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:52.063111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbaa9c-66ed-47b0-85a2-47c37808843d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:52.165345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:52.208168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba23a3-b9de-40c7-8985-f551e1506825 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:52.235372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbaa9c-66ed-47b0-85a2-47c37808843d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:52.267130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:52.290784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67877f-039c-42d5-9541-5ab321fbec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:52.291469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67877f-039c-42d5-9541-5ab321fbec97 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.291816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67877f-039c-42d5-9541-5ab321fbec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.292091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67877f-039c-42d5-9541-5ab321fbec97 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:52.293392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67877f-039c-42d5-9541-5ab321fbec97 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:52.296934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67877f-039c-42d5-9541-5ab321fbec97 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:52.304351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 83/165] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:52 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:52.306477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29a62-dcad-4946-a14c-ac60413872a5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.306763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29a62-dcad-4946-a14c-ac60413872a5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.307040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29a62-dcad-4946-a14c-ac60413872a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:52.314038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb1614-fed1-4d24-b5a4-654b01ec3cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:52.321126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1614-fed1-4d24-b5a4-654b01ec3cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.321126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1614-fed1-4d24-b5a4-654b01ec3cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.321126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1614-fed1-4d24-b5a4-654b01ec3cc0 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:52.321126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb1614-fed1-4d24-b5a4-654b01ec3cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:52.321126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb1614-fed1-4d24-b5a4-654b01ec3cc0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:52.327612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 83/166] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:52 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:52.328525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb1614-fed1-4d24-b5a4-654b01ec3cc0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:52.342882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-7ab29a62-dcad-4946-a14c-ac60413872a5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:52.344286 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7ab29a62-dcad-4946-a14c-ac60413872a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:52.456455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 84/167] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:52.457222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab29a62-dcad-4946-a14c-ac60413872a5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:52.549342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb1614-fed1-4d24-b5a4-654b01ec3cc0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:52.574252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:52.593029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f03a-66b8-4b3c-8d6a-46f775d93d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:52.593029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f03a-66b8-4b3c-8d6a-46f775d93d5a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.593029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f03a-66b8-4b3c-8d6a-46f775d93d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.594876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f03a-66b8-4b3c-8d6a-46f775d93d5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:52.619127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f03a-66b8-4b3c-8d6a-46f775d93d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-8bd3f03a-66b8-4b3c-8d6a-46f775d93d5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:52.625934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:52.626996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:52.627815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 84/168] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:52.629386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f03a-66b8-4b3c-8d6a-46f775d93d5a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:52.636496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab29a62-dcad-4946-a14c-ac60413872a5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:52.707422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:52.733627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:52.734269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.734550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.734825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:52.735634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=81c7e412e96f4fadaa334b907d4734e7, user.id=0b3130018efa44a5a2048fca15b5c1f6) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:52.735989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:52.737468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:52.751064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 85/169] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:52 2022] GET /identity/v3/role_assignments?user.id=0b3130018efa44a5a2048fca15b5c1f6&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:52.751989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:52.778792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f03a-66b8-4b3c-8d6a-46f775d93d5a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:52.826114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:52.826746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.827024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.827294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:52.828095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] RBAC: Adding query filter params (role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=81c7e412e96f4fadaa334b907d4734e7, user.id=48881791ec6346f88994e2d0e77b45c5) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:52.828399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:52.829911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:52.846864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 85/170] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:52 2022] GET /identity/v3/role_assignments?user.id=48881791ec6346f88994e2d0e77b45c5&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:52.847712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:52.941608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334e1e-2d7f-4b7b-944e-a73981e151df None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:52.992360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d3782-ea67-4841-9e7b-5806d1c15b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:52.994169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3782-ea67-4841-9e7b-5806d1c15b1b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.994809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3782-ea67-4841-9e7b-5806d1c15b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.995359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3782-ea67-4841-9e7b-5806d1c15b1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.012328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:53.019410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d3782-ea67-4841-9e7b-5806d1c15b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-5c3d3782-ea67-4841-9e7b-5806d1c15b1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:53.027517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:53.028474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:03:53.029295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:53.031995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 86/171] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:53.038271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d3782-ea67-4841-9e7b-5806d1c15b1b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:53.195795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592071d1-d51e-4fa9-ae89-cc643bdd4912 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:53.209613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d3782-ea67-4841-9e7b-5806d1c15b1b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:53.210928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:53.257917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:53.258961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:53.260082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:53.260782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.261730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:53.262715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:53.264591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:53.274122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 87/172] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:53.280366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:53.280669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:53.281338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:53.281616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:53.281888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.282612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:53.282910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:53.284287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:53.300109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 86/173] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:53.306496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:53.360139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:53.414100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c717e-2e27-4824-a066-d80e0b23c015 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:53.457236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a823764-7fcb-420d-a7a7-68fd4177f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:53.458720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a823764-7fcb-420d-a7a7-68fd4177f421 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:53.459191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a823764-7fcb-420d-a7a7-68fd4177f421 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:53.459666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a823764-7fcb-420d-a7a7-68fd4177f421 None admin] PATH_INFO: `/v3/users/f1d2b9f62b2a4aa59a32268fcd232ee6` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.461155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a823764-7fcb-420d-a7a7-68fd4177f421 None admin] RBAC: Authorizing `identity:get_user(user_id=f1d2b9f62b2a4aa59a32268fcd232ee6)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:53.465147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a823764-7fcb-420d-a7a7-68fd4177f421 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:53.467881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 88/174] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:53 2022] GET /identity/v3/users/f1d2b9f62b2a4aa59a32268fcd232ee6 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:53.474946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a823764-7fcb-420d-a7a7-68fd4177f421 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:53.584264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fc211-936b-450d-bcdc-10ea3902b4fd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:53.608492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a823764-7fcb-420d-a7a7-68fd4177f421 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:53.646701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:53.657074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4271c-215f-4105-b915-d7d34ee79f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:53.658518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4271c-215f-4105-b915-d7d34ee79f78 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:53.659037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4271c-215f-4105-b915-d7d34ee79f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:53.659505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4271c-215f-4105-b915-d7d34ee79f78 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.660900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4271c-215f-4105-b915-d7d34ee79f78 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:53.662792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4271c-215f-4105-b915-d7d34ee79f78 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:53.664654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 89/175] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:53 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:53.672376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4271c-215f-4105-b915-d7d34ee79f78 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:53.705695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dbec0-4698-4b78-8c22-1f23d8bf90cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:53.705695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dbec0-4698-4b78-8c22-1f23d8bf90cd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:53.705695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dbec0-4698-4b78-8c22-1f23d8bf90cd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:53.705695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dbec0-4698-4b78-8c22-1f23d8bf90cd None admin] PATH_INFO: `/v3/users/48881791ec6346f88994e2d0e77b45c5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.707598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dbec0-4698-4b78-8c22-1f23d8bf90cd None admin] RBAC: Authorizing `identity:get_user(user_id=48881791ec6346f88994e2d0e77b45c5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:53.709086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dbec0-4698-4b78-8c22-1f23d8bf90cd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:53.711030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 87/176] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:53 2022] GET /identity/v3/users/48881791ec6346f88994e2d0e77b45c5 => generated 275 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:53.717327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dbec0-4698-4b78-8c22-1f23d8bf90cd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:53.783707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:53.848125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4271c-215f-4105-b915-d7d34ee79f78 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:53.886154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cd0a2-5efd-4cc7-b28c-42e8b42bb5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:53.886840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd0a2-5efd-4cc7-b28c-42e8b42bb5c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:53.887188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd0a2-5efd-4cc7-b28c-42e8b42bb5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:53.887468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd0a2-5efd-4cc7-b28c-42e8b42bb5c3 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7/users/f1d2b9f62b2a4aa59a32268fcd232ee6/roles/77e9c604ddbf4af1ab9adf2ad12a4c46` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.889502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cd0a2-5efd-4cc7-b28c-42e8b42bb5c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=81c7e412e96f4fadaa334b907d4734e7, user_id=f1d2b9f62b2a4aa59a32268fcd232ee6, role_id=77e9c604ddbf4af1ab9adf2ad12a4c46)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:53.891084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cd0a2-5efd-4cc7-b28c-42e8b42bb5c3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:53.921686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dbec0-4698-4b78-8c22-1f23d8bf90cd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:53.959828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250013f7-f529-4b9b-ac93-734ef7a679ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:53.960458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250013f7-f529-4b9b-ac93-734ef7a679ba None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:53.960738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250013f7-f529-4b9b-ac93-734ef7a679ba None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:53.961043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250013f7-f529-4b9b-ac93-734ef7a679ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.972068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 90/177] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:03:53 2022] PUT /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7/users/f1d2b9f62b2a4aa59a32268fcd232ee6/roles/77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:03:54.073128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250013f7-f529-4b9b-ac93-734ef7a679ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:54.074746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250013f7-f529-4b9b-ac93-734ef7a679ba None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:54.122424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:54.214679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 88/178] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:54.220030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cd0a2-5efd-4cc7-b28c-42e8b42bb5c3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:54.282365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a4c5-08b8-4156-98ad-e1d29b08e6f1 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.282688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a4c5-08b8-4156-98ad-e1d29b08e6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.282921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a4c5-08b8-4156-98ad-e1d29b08e6f1 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.284641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 89/179] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:54.293582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188bb1b-428b-4a74-af01-bd282e7831e3 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.294691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188bb1b-428b-4a74-af01-bd282e7831e3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.295069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188bb1b-428b-4a74-af01-bd282e7831e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.311747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:54.317771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f188bb1b-428b-4a74-af01-bd282e7831e3 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:54.319184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f188bb1b-428b-4a74-af01-bd282e7831e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:54.405102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 90/180] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:54.411776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cd0a2-5efd-4cc7-b28c-42e8b42bb5c3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:54.445223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188bb1b-428b-4a74-af01-bd282e7831e3 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:54.468395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9077a-57ac-47c1-91e6-08a42a81fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:54.470369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9077a-57ac-47c1-91e6-08a42a81fea1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.471524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9077a-57ac-47c1-91e6-08a42a81fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.472237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9077a-57ac-47c1-91e6-08a42a81fea1 None admin] PATH_INFO: `/v3/projects/aaebcb92641c42129e588e29072c1631` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.474510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9077a-57ac-47c1-91e6-08a42a81fea1 None admin] RBAC: Authorizing `identity:get_project(project_id=aaebcb92641c42129e588e29072c1631)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:54.477093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9077a-57ac-47c1-91e6-08a42a81fea1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:54.482951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 91/181] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:54 2022] GET /identity/v3/projects/aaebcb92641c42129e588e29072c1631 => generated 312 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:54.488779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9077a-57ac-47c1-91e6-08a42a81fea1 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:54.613015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:54.638272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9077a-57ac-47c1-91e6-08a42a81fea1 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:54.657278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188bb1b-428b-4a74-af01-bd282e7831e3 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:54.667300 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:54.679110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875f710-d063-4328-84e0-a7115e81835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:54.679741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875f710-d063-4328-84e0-a7115e81835f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.680020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875f710-d063-4328-84e0-a7115e81835f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.680293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875f710-d063-4328-84e0-a7115e81835f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.681886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875f710-d063-4328-84e0-a7115e81835f None admin] RBAC: Adding query filter params (role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=aaebcb92641c42129e588e29072c1631, user.id=48881791ec6346f88994e2d0e77b45c5) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:54.682026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875f710-d063-4328-84e0-a7115e81835f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:54.683583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875f710-d063-4328-84e0-a7115e81835f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:54.690643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 92/182] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:54 2022] GET /identity/v3/role_assignments?user.id=48881791ec6346f88994e2d0e77b45c5&scope.project.id=aaebcb92641c42129e588e29072c1631&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:54.692115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573832f6-742c-4684-8aee-1fc350f6a3e4 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.692365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573832f6-742c-4684-8aee-1fc350f6a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.692637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573832f6-742c-4684-8aee-1fc350f6a3e4 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.694069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 93/183] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:54.700194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168c3a9-fbaf-480f-a1f3-9571a24b66a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:54.700398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab1b8-a00f-477a-9bb8-0b1dd14cce75 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.700510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab1b8-a00f-477a-9bb8-0b1dd14cce75 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.700782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab1b8-a00f-477a-9bb8-0b1dd14cce75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.701680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c3a9-fbaf-480f-a1f3-9571a24b66a9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.702161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c3a9-fbaf-480f-a1f3-9571a24b66a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.702622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c3a9-fbaf-480f-a1f3-9571a24b66a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.716384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168c3a9-fbaf-480f-a1f3-9571a24b66a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-a168c3a9-fbaf-480f-a1f3-9571a24b66a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:54.723432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:54.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:54.725212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:54.725809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d0cab1b8-a00f-477a-9bb8-0b1dd14cce75 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:54.727080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d0cab1b8-a00f-477a-9bb8-0b1dd14cce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:54.728832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 91/184] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:03:54.730629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41a61-a3ec-4ef4-b427-ccb38dc5844f None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.731138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41a61-a3ec-4ef4-b427-ccb38dc5844f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.731600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41a61-a3ec-4ef4-b427-ccb38dc5844f None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.733247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 92/185] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:54.737811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca41a61-a3ec-4ef4-b427-ccb38dc5844f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:54.825220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 94/186] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:54.826575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f20af-bc40-4355-b567-ac96f7058594 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.826902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f20af-bc40-4355-b567-ac96f7058594 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.827172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f20af-bc40-4355-b567-ac96f7058594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.856145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3e9f20af-bc40-4355-b567-ac96f7058594 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:54.857498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3e9f20af-bc40-4355-b567-ac96f7058594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:54.867345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca41a61-a3ec-4ef4-b427-ccb38dc5844f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:54.902402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:54.924647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:54.924647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:54.924647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:54.924647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:54.925107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:54.925107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:54.925107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:54.938602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 93/187] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:54.939428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:54.961610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 95/188] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:54.963304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f20af-bc40-4355-b567-ac96f7058594 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:55.024792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:55.064317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934707ef-75c4-43d9-bb87-d5368b0aaecd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:55.091877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f20af-bc40-4355-b567-ac96f7058594 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:55.103089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eead2-7810-478f-b4a9-cc32945eb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:55.103791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eead2-7810-478f-b4a9-cc32945eb140 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:55.104257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eead2-7810-478f-b4a9-cc32945eb140 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:55.104571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eead2-7810-478f-b4a9-cc32945eb140 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:55.105836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eead2-7810-478f-b4a9-cc32945eb140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:55.107321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eead2-7810-478f-b4a9-cc32945eb140 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:55.109102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 94/189] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:55.109724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eead2-7810-478f-b4a9-cc32945eb140 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:55.143754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87aab5-23d9-4c6f-b4b7-d4d590b48bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:55.144808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87aab5-23d9-4c6f-b4b7-d4d590b48bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:55.145206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87aab5-23d9-4c6f-b4b7-d4d590b48bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:55.145489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87aab5-23d9-4c6f-b4b7-d4d590b48bf2 None admin] PATH_INFO: `/v3/users/99ad4a4112bc415ca043ccee221b6b85` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:55.160670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87aab5-23d9-4c6f-b4b7-d4d590b48bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=99ad4a4112bc415ca043ccee221b6b85)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:55.162159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87aab5-23d9-4c6f-b4b7-d4d590b48bf2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:55.164115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 96/190] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:54 2022] GET /identity/v3/users/99ad4a4112bc415ca043ccee221b6b85 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:55.164800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87aab5-23d9-4c6f-b4b7-d4d590b48bf2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:55.183925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:55.243014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eead2-7810-478f-b4a9-cc32945eb140 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:55.284077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fddb9-2026-4a8f-b1a2-9c68f8ff6a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:55.284978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fddb9-2026-4a8f-b1a2-9c68f8ff6a4e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:55.285371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fddb9-2026-4a8f-b1a2-9c68f8ff6a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:55.285528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87aab5-23d9-4c6f-b4b7-d4d590b48bf2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:55.285741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fddb9-2026-4a8f-b1a2-9c68f8ff6a4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:55.295101 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:55.302589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fddb9-2026-4a8f-b1a2-9c68f8ff6a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-d69fddb9-2026-4a8f-b1a2-9c68f8ff6a4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:55.311068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:55.312576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 95/191] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:03:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:55.314284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fddb9-2026-4a8f-b1a2-9c68f8ff6a4e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:55.332349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f36ed3-457b-41d3-bcab-08fec25d2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:55.333004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36ed3-457b-41d3-bcab-08fec25d2943 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:55.333285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36ed3-457b-41d3-bcab-08fec25d2943 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:55.333558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36ed3-457b-41d3-bcab-08fec25d2943 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:55.334247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f36ed3-457b-41d3-bcab-08fec25d2943 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:55.335909 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f36ed3-457b-41d3-bcab-08fec25d2943 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:55.423408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fddb9-2026-4a8f-b1a2-9c68f8ff6a4e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:55.441584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:55.461001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4bbb5-847a-4783-895a-a716da28aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:55.461685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4bbb5-847a-4783-895a-a716da28aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:55.471645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4bbb5-847a-4783-895a-a716da28aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:55.471645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4bbb5-847a-4783-895a-a716da28aee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:55.471877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 97/192] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:03:55 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:55.471877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f36ed3-457b-41d3-bcab-08fec25d2943 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:55.569632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4bbb5-847a-4783-895a-a716da28aee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:55.572549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4bbb5-847a-4783-895a-a716da28aee8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:55.594034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f36ed3-457b-41d3-bcab-08fec25d2943 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:55.635587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:55.636450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:55.636827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:55.637563 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:55.638431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:55.638834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:55.640363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:55.654011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 98/193] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:03:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:55.659553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:55.693636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:55.704465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 96/194] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:55.716218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4bbb5-847a-4783-895a-a716da28aee8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:55.738641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:55.827313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cad5d-fab2-47e4-8534-56367d7aab10 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:55.858863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4bbb5-847a-4783-895a-a716da28aee8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:55.888727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42fb73-45ee-4feb-af91-281ac89d5ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:55.889743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42fb73-45ee-4feb-af91-281ac89d5ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:55.890108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42fb73-45ee-4feb-af91-281ac89d5ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:55.890488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42fb73-45ee-4feb-af91-281ac89d5ee9 None admin] PATH_INFO: `/v3/users/99ad4a4112bc415ca043ccee221b6b85` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:55.892240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42fb73-45ee-4feb-af91-281ac89d5ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=99ad4a4112bc415ca043ccee221b6b85)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:55.894329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42fb73-45ee-4feb-af91-281ac89d5ee9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:55.896854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 99/195] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:55 2022] GET /identity/v3/users/99ad4a4112bc415ca043ccee221b6b85 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:55.903855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42fb73-45ee-4feb-af91-281ac89d5ee9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:55.921548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66ef02-166a-4829-a8c2-dbba938aaaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:55.922692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ef02-166a-4829-a8c2-dbba938aaaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:55.923196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ef02-166a-4829-a8c2-dbba938aaaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:55.923698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66ef02-166a-4829-a8c2-dbba938aaaa8 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:55.926349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66ef02-166a-4829-a8c2-dbba938aaaa8 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:55.928249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66ef02-166a-4829-a8c2-dbba938aaaa8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:55.930359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 97/196] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:55 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:55.938604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66ef02-166a-4829-a8c2-dbba938aaaa8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:56.022121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:56.031472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42fb73-45ee-4feb-af91-281ac89d5ee9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:56.066445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:56.074030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ad864-fb0b-4d6a-9f09-5fb5b1e5b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:56.074786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ad864-fb0b-4d6a-9f09-5fb5b1e5b62f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.075061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ad864-fb0b-4d6a-9f09-5fb5b1e5b62f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.075403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ad864-fb0b-4d6a-9f09-5fb5b1e5b62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.096663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66ef02-166a-4829-a8c2-dbba938aaaa8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:56.144868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:56.145908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.146365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.146870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.148582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38, user.id=99ad4a4112bc415ca043ccee221b6b85) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:56.149575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:56.151424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:56.165863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 98/197] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:55 2022] GET /identity/v3/role_assignments?user.id=99ad4a4112bc415ca043ccee221b6b85&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:56.221228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ad864-fb0b-4d6a-9f09-5fb5b1e5b62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:56.223006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ad864-fb0b-4d6a-9f09-5fb5b1e5b62f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:56.350706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:56.363884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 100/198] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:56.370086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:56.453295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e9a1-d6af-4555-8741-856da35ec135 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.453295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e9a1-d6af-4555-8741-856da35ec135 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.453295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8e9a1-d6af-4555-8741-856da35ec135 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.454345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 101/199] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:56.469430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07e344-bb39-4b4e-9ca3-9a57fab0b3d7 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.469717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07e344-bb39-4b4e-9ca3-9a57fab0b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.469977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07e344-bb39-4b4e-9ca3-9a57fab0b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.498818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-cf07e344-bb39-4b4e-9ca3-9a57fab0b3d7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:56.498818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cf07e344-bb39-4b4e-9ca3-9a57fab0b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:56.575656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670766f5-9130-41f7-8499-1002cd38f830 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:56.631329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b5389-8749-4462-9c3d-fb4f0aadc31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:56.631989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b5389-8749-4462-9c3d-fb4f0aadc31a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.633721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 102/200] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:56.634553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b5389-8749-4462-9c3d-fb4f0aadc31a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.634996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b5389-8749-4462-9c3d-fb4f0aadc31a None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.636352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b5389-8749-4462-9c3d-fb4f0aadc31a None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:56.637895 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b5389-8749-4462-9c3d-fb4f0aadc31a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:56.640377 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 99/201] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:56 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:56.651297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07e344-bb39-4b4e-9ca3-9a57fab0b3d7 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:56.661996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b5389-8749-4462-9c3d-fb4f0aadc31a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:56.705405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:56.792580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07e344-bb39-4b4e-9ca3-9a57fab0b3d7 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:56.822051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:56.844758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:56.845833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.846938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.847215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.848022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] RBAC: Adding query filter params (role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38, user.id=99ad4a4112bc415ca043ccee221b6b85) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:56.848330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:56.849863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:56.857032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 103/202] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:56 2022] GET /identity/v3/role_assignments?user.id=99ad4a4112bc415ca043ccee221b6b85&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:56.918279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b5389-8749-4462-9c3d-fb4f0aadc31a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:56.960382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa8021-2d55-431b-981b-ee050391f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:56.961066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8021-2d55-431b-981b-ee050391f3ec None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.961347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8021-2d55-431b-981b-ee050391f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.961622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8021-2d55-431b-981b-ee050391f3ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.975145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa8021-2d55-431b-981b-ee050391f3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-91aa8021-2d55-431b-981b-ee050391f3ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:56.982473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:56.983501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:03:56.984307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:56.988782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 100/203] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:56.990401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.141175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768f382-11fd-45f9-ba80-f5a3423c3f76 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.183665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.184217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.184497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.184770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.185532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:57.185838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.187296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.197216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 104/204] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:57.203360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa8021-2d55-431b-981b-ee050391f3ec None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.328545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:57.367011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa8021-2d55-431b-981b-ee050391f3ec None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.475551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da153820-5162-4110-bf97-a822ff07fa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.476602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153820-5162-4110-bf97-a822ff07fa36 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.477121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153820-5162-4110-bf97-a822ff07fa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.478184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153820-5162-4110-bf97-a822ff07fa36 None admin] PATH_INFO: `/v3/users/f1d2b9f62b2a4aa59a32268fcd232ee6` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.480311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da153820-5162-4110-bf97-a822ff07fa36 None admin] RBAC: Authorizing `identity:get_user(user_id=f1d2b9f62b2a4aa59a32268fcd232ee6)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.482738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da153820-5162-4110-bf97-a822ff07fa36 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.485753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 101/205] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:57 2022] GET /identity/v3/users/f1d2b9f62b2a4aa59a32268fcd232ee6 => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:57.494533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.572749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:57.648176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f20d4-d5b6-4932-a737-5f09c88c42a5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.697450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8b0e-66bd-4b5d-ad6d-9153758e97dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.698119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8b0e-66bd-4b5d-ad6d-9153758e97dc None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.698401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8b0e-66bd-4b5d-ad6d-9153758e97dc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.698671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8b0e-66bd-4b5d-ad6d-9153758e97dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.792960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc8b0e-66bd-4b5d-ad6d-9153758e97dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.795754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc8b0e-66bd-4b5d-ad6d-9153758e97dc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.871977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:57.940111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 105/206] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:03:57.941579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da153820-5162-4110-bf97-a822ff07fa36 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.064932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da153820-5162-4110-bf97-a822ff07fa36 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.109320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a916d-8259-4225-b9e7-6a16d1237015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.109969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a916d-8259-4225-b9e7-6a16d1237015 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.110241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a916d-8259-4225-b9e7-6a16d1237015 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.110510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a916d-8259-4225-b9e7-6a16d1237015 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.111712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a916d-8259-4225-b9e7-6a16d1237015 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.113321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a916d-8259-4225-b9e7-6a16d1237015 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.120932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 102/207] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:57 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:58.122530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8b0e-66bd-4b5d-ad6d-9153758e97dc None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.152239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4d5d-f713-471d-a3e9-2396a1f90574 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.152585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4d5d-f713-471d-a3e9-2396a1f90574 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.152862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4d5d-f713-471d-a3e9-2396a1f90574 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.154634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 103/208] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:03:58.180040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14259ca-ead4-4573-bab5-d4bb42a2bb24 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.180453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14259ca-ead4-4573-bab5-d4bb42a2bb24 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.180858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14259ca-ead4-4573-bab5-d4bb42a2bb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.205313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e14259ca-ead4-4573-bab5-d4bb42a2bb24 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:58.206512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e14259ca-ead4-4573-bab5-d4bb42a2bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:58.219911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:58.316118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8b0e-66bd-4b5d-ad6d-9153758e97dc None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.340843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 104/209] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:03:58.366503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b3e74-c9b4-497e-8f90-daa21fa40502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.367211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3e74-c9b4-497e-8f90-daa21fa40502 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.367488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3e74-c9b4-497e-8f90-daa21fa40502 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.367765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3e74-c9b4-497e-8f90-daa21fa40502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.369330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b3e74-c9b4-497e-8f90-daa21fa40502 None admin] RBAC: Adding query filter params (role.id=77e9c604ddbf4af1ab9adf2ad12a4c46, scope.project.id=81c7e412e96f4fadaa334b907d4734e7, user.id=f1d2b9f62b2a4aa59a32268fcd232ee6) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:58.369868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b3e74-c9b4-497e-8f90-daa21fa40502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.371375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b3e74-c9b4-497e-8f90-daa21fa40502 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.385009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 106/210] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:58 2022] GET /identity/v3/role_assignments?user.id=f1d2b9f62b2a4aa59a32268fcd232ee6&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:58.390852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14259ca-ead4-4573-bab5-d4bb42a2bb24 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.537687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14259ca-ead4-4573-bab5-d4bb42a2bb24 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.594473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b1cf-60b0-41e5-8e9b-11ce17662a3b None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.594970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b1cf-60b0-41e5-8e9b-11ce17662a3b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.594970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b1cf-60b0-41e5-8e9b-11ce17662a3b None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.596429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 107/211] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:03:58.606378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18bea-d57b-4aa2-befb-87a0e6940375 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.606693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18bea-d57b-4aa2-befb-87a0e6940375 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.606932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18bea-d57b-4aa2-befb-87a0e6940375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.607175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c47bc-c4de-48af-82c4-e5b6260f1d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.608085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c47bc-c4de-48af-82c4-e5b6260f1d72 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.608761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c47bc-c4de-48af-82c4-e5b6260f1d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.609212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c47bc-c4de-48af-82c4-e5b6260f1d72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.629031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c47bc-c4de-48af-82c4-e5b6260f1d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:58.638195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9cd18bea-d57b-4aa2-befb-87a0e6940375 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-b02c47bc-c4de-48af-82c4-e5b6260f1d72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:58.639442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:58.640329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:03:58.641161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:03:58.641765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 105/212] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:58.642751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9cd18bea-d57b-4aa2-befb-87a0e6940375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:58.651773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c47bc-c4de-48af-82c4-e5b6260f1d72 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.658311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:58.660695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:58.741557 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 108/213] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:58.770892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd18bea-d57b-4aa2-befb-87a0e6940375 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.828156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c47bc-c4de-48af-82c4-e5b6260f1d72 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.888437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.889788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.890653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.891745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.893363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:58.894323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.897783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.902345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd18bea-d57b-4aa2-befb-87a0e6940375 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.917548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 106/214] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:03:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:58.923190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.958359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617116-186c-4fbe-95ed-39f0224a1099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.959544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617116-186c-4fbe-95ed-39f0224a1099 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.959995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617116-186c-4fbe-95ed-39f0224a1099 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.960590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617116-186c-4fbe-95ed-39f0224a1099 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.962379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617116-186c-4fbe-95ed-39f0224a1099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.964490 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617116-186c-4fbe-95ed-39f0224a1099 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.966998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 109/215] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:03:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:58.975754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617116-186c-4fbe-95ed-39f0224a1099 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.992596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.025403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.083946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84729cd9-296b-4b57-a6b5-eb22f4f47868 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:59.125483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b929eff-ef0c-45f0-ac2b-53bd8b4ad208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:59.126395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929eff-ef0c-45f0-ac2b-53bd8b4ad208 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.126850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929eff-ef0c-45f0-ac2b-53bd8b4ad208 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.127099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617116-186c-4fbe-95ed-39f0224a1099 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:59.127415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929eff-ef0c-45f0-ac2b-53bd8b4ad208 None admin] PATH_INFO: `/v3/users/8bfe31c2e7e243baa15361833dbb888e` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.152533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b929eff-ef0c-45f0-ac2b-53bd8b4ad208 None admin] RBAC: Authorizing `identity:get_user(user_id=8bfe31c2e7e243baa15361833dbb888e)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:59.154654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b929eff-ef0c-45f0-ac2b-53bd8b4ad208 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:59.157613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 107/216] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:03:58 2022] GET /identity/v3/users/8bfe31c2e7e243baa15361833dbb888e => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:59.163871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b929eff-ef0c-45f0-ac2b-53bd8b4ad208 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:59.177796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8558fdd-200f-46b3-9544-225726ad636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:59.178431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558fdd-200f-46b3-9544-225726ad636a None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.178712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558fdd-200f-46b3-9544-225726ad636a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.178988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8558fdd-200f-46b3-9544-225726ad636a None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.180164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8558fdd-200f-46b3-9544-225726ad636a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:59.182050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8558fdd-200f-46b3-9544-225726ad636a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:59.293353 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 110/217] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:03:58 2022] POST /identity/v3/users => generated 297 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:03:59.295913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffde3e-595f-4f5e-b9df-c42ce75566c5 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.296237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffde3e-595f-4f5e-b9df-c42ce75566c5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.296335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b929eff-ef0c-45f0-ac2b-53bd8b4ad208 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:59.296510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffde3e-595f-4f5e-b9df-c42ce75566c5 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.298117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 111/218] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:59.304345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2b84-5495-4f3f-94dc-b9221e635966 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.304665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2b84-5495-4f3f-94dc-b9221e635966 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.304921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2b84-5495-4f3f-94dc-b9221e635966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.325560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.340535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1b7d7-0762-47bb-8fee-0c0312f26172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:59.341217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b7d7-0762-47bb-8fee-0c0312f26172 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.341521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b7d7-0762-47bb-8fee-0c0312f26172 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.341780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b7d7-0762-47bb-8fee-0c0312f26172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.350024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-241a2b84-5495-4f3f-94dc-b9221e635966 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:59.351275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-241a2b84-5495-4f3f-94dc-b9221e635966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:59.439018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1b7d7-0762-47bb-8fee-0c0312f26172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:59.441082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1b7d7-0762-47bb-8fee-0c0312f26172 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:59.454699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.461292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 112/219] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:59.485772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2b84-5495-4f3f-94dc-b9221e635966 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:59.614677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 108/220] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:03:59.616367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adafcfb-8127-4b26-a2a7-d77b580e35eb None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.616744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adafcfb-8127-4b26-a2a7-d77b580e35eb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.619321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adafcfb-8127-4b26-a2a7-d77b580e35eb None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.619551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2b84-5495-4f3f-94dc-b9221e635966 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:59.620150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 109/221] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:03:59.622061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adafcfb-8127-4b26-a2a7-d77b580e35eb None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:59.654788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.678585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ada622-cdc3-4a3f-8580-d01cab282cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:59.679589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada622-cdc3-4a3f-8580-d01cab282cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.680007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada622-cdc3-4a3f-8580-d01cab282cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.680540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ada622-cdc3-4a3f-8580-d01cab282cb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.694869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ada622-cdc3-4a3f-8580-d01cab282cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-46ada622-cdc3-4a3f-8580-d01cab282cb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:03:59.700262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:03:59.703260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 113/222] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:03:59.707610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28a93-9441-40aa-bb1a-dd464e97741a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.711788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28a93-9441-40aa-bb1a-dd464e97741a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.711788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec28a93-9441-40aa-bb1a-dd464e97741a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.742679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-dec28a93-9441-40aa-bb1a-dd464e97741a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:59.745420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-dec28a93-9441-40aa-bb1a-dd464e97741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:59.766075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adafcfb-8127-4b26-a2a7-d77b580e35eb None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:59.816654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.818893 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7bf91-d3bc-4e9c-9fb6-e1e3136d1238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:59.819583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7bf91-d3bc-4e9c-9fb6-e1e3136d1238 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.819912 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7bf91-d3bc-4e9c-9fb6-e1e3136d1238 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.820234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7bf91-d3bc-4e9c-9fb6-e1e3136d1238 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.821642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7bf91-d3bc-4e9c-9fb6-e1e3136d1238 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:59.823026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7bf91-d3bc-4e9c-9fb6-e1e3136d1238 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:59.824917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 110/223] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:03:59 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:03:59.825962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7bf91-d3bc-4e9c-9fb6-e1e3136d1238 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:59.838551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 114/224] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:03:59.839724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec28a93-9441-40aa-bb1a-dd464e97741a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:59.946612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.956998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7bf91-d3bc-4e9c-9fb6-e1e3136d1238 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:59.968949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec28a93-9441-40aa-bb1a-dd464e97741a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.005325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.006447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.006894 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.007307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.008337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:00.009458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.010915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.023251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 111/225] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:03:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:00.025319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.030273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.030916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.031198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.031471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.032272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] RBAC: Adding query filter params (role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38, user.id=8bfe31c2e7e243baa15361833dbb888e) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:00.032613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.034093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.043366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 115/226] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:03:59 2022] GET /identity/v3/role_assignments?user.id=8bfe31c2e7e243baa15361833dbb888e&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:00.044216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.129274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:00.213490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c453e9-b67a-42e9-ac3b-7130e41022c8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.241010 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f3f79-7064-4d05-aa67-10f006107435 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.281683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b1d7e-b990-4eda-85c8-7b51bcb0171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.282871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1d7e-b990-4eda-85c8-7b51bcb0171d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.283461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1d7e-b990-4eda-85c8-7b51bcb0171d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.283946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b1d7e-b990-4eda-85c8-7b51bcb0171d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.294662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa9835-4a91-4b57-834b-1c3ad665fddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.295382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9835-4a91-4b57-834b-1c3ad665fddf None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.295592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9835-4a91-4b57-834b-1c3ad665fddf None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.295869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9835-4a91-4b57-834b-1c3ad665fddf None admin] PATH_INFO: `/v3/users/99ad4a4112bc415ca043ccee221b6b85` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.297092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa9835-4a91-4b57-834b-1c3ad665fddf None admin] RBAC: Authorizing `identity:get_user(user_id=99ad4a4112bc415ca043ccee221b6b85)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.298562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa9835-4a91-4b57-834b-1c3ad665fddf None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.299398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b1d7e-b990-4eda-85c8-7b51bcb0171d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:00.303246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 116/227] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:00 2022] GET /identity/v3/users/99ad4a4112bc415ca043ccee221b6b85 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-8f6b1d7e-b990-4eda-85c8-7b51bcb0171d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:00.307189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:00.308096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:00.309331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 112/228] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:00.312719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa9835-4a91-4b57-834b-1c3ad665fddf None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.314920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b1d7e-b990-4eda-85c8-7b51bcb0171d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.340803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:00.473993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b1d7e-b990-4eda-85c8-7b51bcb0171d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.532608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa9835-4a91-4b57-834b-1c3ad665fddf None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.545728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.546381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.546659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.546927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.547754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:00.548055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.551233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.569430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 113/229] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:00.574294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.575052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:00.600596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e5335-d66d-4bb3-9d4b-962220494572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.601279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e5335-d66d-4bb3-9d4b-962220494572 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.601554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e5335-d66d-4bb3-9d4b-962220494572 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.601824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e5335-d66d-4bb3-9d4b-962220494572 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.603753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e5335-d66d-4bb3-9d4b-962220494572 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.606567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e5335-d66d-4bb3-9d4b-962220494572 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.608530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 117/230] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:00 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:00.615726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e5335-d66d-4bb3-9d4b-962220494572 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.749344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:00.789672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae79f-0bb2-465c-82f9-26755f0e04cd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.811271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e5335-d66d-4bb3-9d4b-962220494572 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.855069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c3db9-753f-491e-9d62-f78ab6d1d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.855789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3db9-753f-491e-9d62-f78ab6d1d441 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.856069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3db9-753f-491e-9d62-f78ab6d1d441 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.856341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3db9-753f-491e-9d62-f78ab6d1d441 None admin] PATH_INFO: `/v3/users/99ad4a4112bc415ca043ccee221b6b85` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.857669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c3db9-753f-491e-9d62-f78ab6d1d441 None admin] RBAC: Authorizing `identity:get_user(user_id=99ad4a4112bc415ca043ccee221b6b85)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.862523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c3db9-753f-491e-9d62-f78ab6d1d441 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.864582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 114/231] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:00 2022] GET /identity/v3/users/99ad4a4112bc415ca043ccee221b6b85 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:00.871183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c3db9-753f-491e-9d62-f78ab6d1d441 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.894181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6ecf1-46c7-4cf5-bbb3-f6c34e55f9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.897134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ecf1-46c7-4cf5-bbb3-f6c34e55f9cc None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.897556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ecf1-46c7-4cf5-bbb3-f6c34e55f9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.897926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ecf1-46c7-4cf5-bbb3-f6c34e55f9cc None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/users/99ad4a4112bc415ca043ccee221b6b85/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.902747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6ecf1-46c7-4cf5-bbb3-f6c34e55f9cc None admin] RBAC: Authorizing `identity:create_grant(project_id=51fa6c38b60446aa9a9d93a3a3980e38, user_id=99ad4a4112bc415ca043ccee221b6b85, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.907077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6ecf1-46c7-4cf5-bbb3-f6c34e55f9cc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.018598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c3db9-753f-491e-9d62-f78ab6d1d441 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.029029 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 118/232] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:00 2022] PUT /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/users/99ad4a4112bc415ca043ccee221b6b85/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:01.063643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcc3c6-fe09-49af-984f-2177e4b4073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.064313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc3c6-fe09-49af-984f-2177e4b4073f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.064593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc3c6-fe09-49af-984f-2177e4b4073f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.064857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc3c6-fe09-49af-984f-2177e4b4073f None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.067989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcc3c6-fe09-49af-984f-2177e4b4073f None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.069528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcc3c6-fe09-49af-984f-2177e4b4073f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.072109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 115/233] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:00 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:01.078224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6ecf1-46c7-4cf5-bbb3-f6c34e55f9cc None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.163379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:01.242059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6ecf1-46c7-4cf5-bbb3-f6c34e55f9cc None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.287524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd495a7-ef18-490f-be09-686e60e43561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.288219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd495a7-ef18-490f-be09-686e60e43561 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.288496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd495a7-ef18-490f-be09-686e60e43561 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.288805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd495a7-ef18-490f-be09-686e60e43561 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/users/99ad4a4112bc415ca043ccee221b6b85/roles/59b4966b7b764eb5bc24547e4faef790` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.292057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd495a7-ef18-490f-be09-686e60e43561 None admin] RBAC: Authorizing `identity:create_grant(project_id=51fa6c38b60446aa9a9d93a3a3980e38, user_id=99ad4a4112bc415ca043ccee221b6b85, role_id=59b4966b7b764eb5bc24547e4faef790)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.295028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd495a7-ef18-490f-be09-686e60e43561 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.383285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 119/234] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:01 2022] PUT /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/users/99ad4a4112bc415ca043ccee221b6b85/roles/59b4966b7b764eb5bc24547e4faef790 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:01.980540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1a1ed-eeed-4e25-b681-e0a2419e3de6 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.981639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1a1ed-eeed-4e25-b681-e0a2419e3de6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.982379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1a1ed-eeed-4e25-b681-e0a2419e3de6 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.984332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 116/235] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:01.991588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ead36-6761-434e-8f98-0b8891ddd4ea None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.992500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ead36-6761-434e-8f98-0b8891ddd4ea None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.993709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ead36-6761-434e-8f98-0b8891ddd4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.017007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9b0ead36-6761-434e-8f98-0b8891ddd4ea None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:02.018548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9b0ead36-6761-434e-8f98-0b8891ddd4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:02.067304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c6e57-d483-4124-bac7-44561d274577 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.067613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c6e57-d483-4124-bac7-44561d274577 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.067853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c6e57-d483-4124-bac7-44561d274577 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.069375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 117/236] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:02.085259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573a089-b28b-4a0d-bc18-2bdd57562503 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.085569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573a089-b28b-4a0d-bc18-2bdd57562503 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.085811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573a089-b28b-4a0d-bc18-2bdd57562503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.105801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 120/237] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:02.125349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4573a089-b28b-4a0d-bc18-2bdd57562503 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:02.126957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4573a089-b28b-4a0d-bc18-2bdd57562503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:02.134282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ead36-6761-434e-8f98-0b8891ddd4ea None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:02.141363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:02.196444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:02.244977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 118/238] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:02.292166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573a089-b28b-4a0d-bc18-2bdd57562503 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:02.337069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ead36-6761-434e-8f98-0b8891ddd4ea None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:02.408910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f76c2f-c666-483f-a4ce-64ddf61923c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:02.408910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f76c2f-c666-483f-a4ce-64ddf61923c4 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.408910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f76c2f-c666-483f-a4ce-64ddf61923c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.408910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f76c2f-c666-483f-a4ce-64ddf61923c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.413425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f76c2f-c666-483f-a4ce-64ddf61923c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-b8f76c2f-c666-483f-a4ce-64ddf61923c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:02.424930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:02.425872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:02.426753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 121/239] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:02.429081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f76c2f-c666-483f-a4ce-64ddf61923c4 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:02.497117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573a089-b28b-4a0d-bc18-2bdd57562503 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:02.570160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebeb5c-0aeb-42d1-ac9a-814b8ffa97e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:02.570824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebeb5c-0aeb-42d1-ac9a-814b8ffa97e0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.571636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebeb5c-0aeb-42d1-ac9a-814b8ffa97e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.572179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebeb5c-0aeb-42d1-ac9a-814b8ffa97e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.574761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebeb5c-0aeb-42d1-ac9a-814b8ffa97e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:02.575894 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebeb5c-0aeb-42d1-ac9a-814b8ffa97e0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:02.580993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 119/240] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:02.580993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e270e-5d78-4bbc-8721-f74fc7d071a8 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.580993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e270e-5d78-4bbc-8721-f74fc7d071a8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.580993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e270e-5d78-4bbc-8721-f74fc7d071a8 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.581594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 120/241] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:02.588271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374d3a-28c3-49bc-b06a-1bb0c4c82797 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.588271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374d3a-28c3-49bc-b06a-1bb0c4c82797 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.588271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374d3a-28c3-49bc-b06a-1bb0c4c82797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.608243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-33374d3a-28c3-49bc-b06a-1bb0c4c82797 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:02.609823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-33374d3a-28c3-49bc-b06a-1bb0c4c82797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:02.613103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:02.627500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:02.638060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f76c2f-c666-483f-a4ce-64ddf61923c4 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:02.695075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:02.696118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.696118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.696771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.697095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:02.697474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:02.698888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:02.709288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 122/242] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:02.710179 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:02.710852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 121/243] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:02.717661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374d3a-28c3-49bc-b06a-1bb0c4c82797 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:02.834149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374d3a-28c3-49bc-b06a-1bb0c4c82797 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:02.869346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38e163-a42f-4667-a9d5-688dfa3b6fe8 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:02.876769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f67fe-4e78-4809-911b-5c06c390095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:02.877575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f67fe-4e78-4809-911b-5c06c390095b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.877945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f67fe-4e78-4809-911b-5c06c390095b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.878312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f67fe-4e78-4809-911b-5c06c390095b None admin] PATH_INFO: `/v3/users/0ffba3ec26e34676909b48cdc9e2e7ed` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.889602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:02.897322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f67fe-4e78-4809-911b-5c06c390095b None admin] RBAC: Authorizing `identity:get_user(user_id=0ffba3ec26e34676909b48cdc9e2e7ed)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:02.899140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f67fe-4e78-4809-911b-5c06c390095b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:02.902147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 122/244] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:02 2022] GET /identity/v3/users/0ffba3ec26e34676909b48cdc9e2e7ed => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:02.903142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f67fe-4e78-4809-911b-5c06c390095b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:02.919698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4ff13-60e2-4e77-9cd9-f0447146696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:02.920747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4ff13-60e2-4e77-9cd9-f0447146696d None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.921086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4ff13-60e2-4e77-9cd9-f0447146696d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.921364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4ff13-60e2-4e77-9cd9-f0447146696d None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.922059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4ff13-60e2-4e77-9cd9-f0447146696d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:02.924177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4ff13-60e2-4e77-9cd9-f0447146696d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:03.036510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f67fe-4e78-4809-911b-5c06c390095b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:03.062874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 123/245] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:04:02 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:03.063727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4ff13-60e2-4e77-9cd9-f0447146696d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:03.090807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:03.093614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6dbe8-e2c7-4a83-aeaf-b470c46c1cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:03.094282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6dbe8-e2c7-4a83-aeaf-b470c46c1cad None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.094608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6dbe8-e2c7-4a83-aeaf-b470c46c1cad None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.094887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6dbe8-e2c7-4a83-aeaf-b470c46c1cad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.109036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6dbe8-e2c7-4a83-aeaf-b470c46c1cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-77e6dbe8-e2c7-4a83-aeaf-b470c46c1cad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:03.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:03.115554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:03.117007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 123/246] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:03.124736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6dbe8-e2c7-4a83-aeaf-b470c46c1cad None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:03.195096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:03.204929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4ff13-60e2-4e77-9cd9-f0447146696d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:03.245817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f420c-cd9c-4a03-90bf-940ce798cf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:03.246836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f420c-cd9c-4a03-90bf-940ce798cf71 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.247125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f420c-cd9c-4a03-90bf-940ce798cf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.247548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f420c-cd9c-4a03-90bf-940ce798cf71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.251224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6dbe8-e2c7-4a83-aeaf-b470c46c1cad None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:03.293268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:03.294270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.294554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.294826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.295677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:03.296124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:03.297699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:03.308488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 124/247] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:03.314677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:03.326868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f420c-cd9c-4a03-90bf-940ce798cf71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:03.328570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f420c-cd9c-4a03-90bf-940ce798cf71 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:03.346381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:03.450719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 124/248] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:03.470297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f420c-cd9c-4a03-90bf-940ce798cf71 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:03.502802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c85762-5254-4ef0-8d44-53eb22514480 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:03.530543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:03.560016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635d2cc-820c-4f92-83b0-fb84ff7de945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:03.561108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635d2cc-820c-4f92-83b0-fb84ff7de945 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.561731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635d2cc-820c-4f92-83b0-fb84ff7de945 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.562231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635d2cc-820c-4f92-83b0-fb84ff7de945 None admin] PATH_INFO: `/v3/users/8bfe31c2e7e243baa15361833dbb888e` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.563696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635d2cc-820c-4f92-83b0-fb84ff7de945 None admin] RBAC: Authorizing `identity:get_user(user_id=8bfe31c2e7e243baa15361833dbb888e)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:03.565577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635d2cc-820c-4f92-83b0-fb84ff7de945 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:03.567481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 125/249] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:03 2022] GET /identity/v3/users/8bfe31c2e7e243baa15361833dbb888e => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:03.573490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635d2cc-820c-4f92-83b0-fb84ff7de945 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:03.613047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f420c-cd9c-4a03-90bf-940ce798cf71 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:03.634910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:03.668956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39ce65-ad2e-4b87-922c-c44d8fe7c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:03.668956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39ce65-ad2e-4b87-922c-c44d8fe7c695 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.668956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39ce65-ad2e-4b87-922c-c44d8fe7c695 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.668956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39ce65-ad2e-4b87-922c-c44d8fe7c695 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.669355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39ce65-ad2e-4b87-922c-c44d8fe7c695 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:03.669355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39ce65-ad2e-4b87-922c-c44d8fe7c695 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:03.670382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 125/250] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:03 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:03.677579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39ce65-ad2e-4b87-922c-c44d8fe7c695 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:03.781782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635d2cc-820c-4f92-83b0-fb84ff7de945 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:03.809572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39ce65-ad2e-4b87-922c-c44d8fe7c695 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:03.838490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ebd70-abb7-4c3e-9c60-da9346699634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:03.839831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ebd70-abb7-4c3e-9c60-da9346699634 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.840110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ebd70-abb7-4c3e-9c60-da9346699634 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.840383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ebd70-abb7-4c3e-9c60-da9346699634 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.841856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ebd70-abb7-4c3e-9c60-da9346699634 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:03.843980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ebd70-abb7-4c3e-9c60-da9346699634 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:03.845963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 126/251] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:03 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:03.847985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc8ef-d611-4e76-8c01-95c47ac86342 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.848291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc8ef-d611-4e76-8c01-95c47ac86342 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.848566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc8ef-d611-4e76-8c01-95c47ac86342 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.852944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 127/252] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:03.857904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16848dfc-9219-4826-9bcd-12254c5540cd None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.858173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16848dfc-9219-4826-9bcd-12254c5540cd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.858437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16848dfc-9219-4826-9bcd-12254c5540cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.860318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:03.861125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.861384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.861605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.862403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] RBAC: Adding query filter params (role.id=77e9c604ddbf4af1ab9adf2ad12a4c46, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38, user.id=0ffba3ec26e34676909b48cdc9e2e7ed) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:03.862716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:03.864257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:03.871083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 126/253] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:03 2022] GET /identity/v3/role_assignments?user.id=0ffba3ec26e34676909b48cdc9e2e7ed&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:03.871989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:03.881772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-16848dfc-9219-4826-9bcd-12254c5540cd None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:03.884704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-16848dfc-9219-4826-9bcd-12254c5540cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:03.965314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:04.019033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:04.022434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc064a53-ad9a-4639-a2b1-85db8d6461da None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:04.084688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d442170-695b-448d-8b37-f6dc1d918268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:04.085571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d442170-695b-448d-8b37-f6dc1d918268 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:04.085673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d442170-695b-448d-8b37-f6dc1d918268 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:04.085951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d442170-695b-448d-8b37-f6dc1d918268 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/users/8bfe31c2e7e243baa15361833dbb888e/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:04.086303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 128/254] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:04.092136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d442170-695b-448d-8b37-f6dc1d918268 None admin] RBAC: Authorizing `identity:create_grant(project_id=51fa6c38b60446aa9a9d93a3a3980e38, user_id=8bfe31c2e7e243baa15361833dbb888e, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:04.093665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d442170-695b-448d-8b37-f6dc1d918268 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:04.117680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16848dfc-9219-4826-9bcd-12254c5540cd None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:04.187962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 127/255] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:03 2022] PUT /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/users/8bfe31c2e7e243baa15361833dbb888e/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:04.213016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2316fe9-14b3-4a57-b5d2-cd352895e7e0 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:04.213319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2316fe9-14b3-4a57-b5d2-cd352895e7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:04.213571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2316fe9-14b3-4a57-b5d2-cd352895e7e0 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:04.214976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 128/256] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:04.220257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f113757-d31f-4816-b48b-ec2b2e035036 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:04.220532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f113757-d31f-4816-b48b-ec2b2e035036 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:04.220814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f113757-d31f-4816-b48b-ec2b2e035036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:04.249446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-4f113757-d31f-4816-b48b-ec2b2e035036 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:04.250682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4f113757-d31f-4816-b48b-ec2b2e035036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:04.291279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16848dfc-9219-4826-9bcd-12254c5540cd None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:04.331931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e78b9-e527-480f-b940-c973858e22b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:04.332620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e78b9-e527-480f-b940-c973858e22b7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:04.332934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e78b9-e527-480f-b940-c973858e22b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:04.333383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e78b9-e527-480f-b940-c973858e22b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:04.348309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e78b9-e527-480f-b940-c973858e22b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-ab9e78b9-e527-480f-b940-c973858e22b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:04.354383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:04.355333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:04.356130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 129/257] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:04.366383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e78b9-e527-480f-b940-c973858e22b7 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:04.425667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 129/258] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:04.477729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:04.502987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f113757-d31f-4816-b48b-ec2b2e035036 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:04.558412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:04.621911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e78b9-e527-480f-b940-c973858e22b7 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:04.677506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f113757-d31f-4816-b48b-ec2b2e035036 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:04.706960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:04.707597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:04.707876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:04.708149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:04.711152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:04.711531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:04.718785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:04.748457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 130/259] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:04.760425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:04.798849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf07d33-5b20-4180-aa0d-5ae17d93a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:04.800763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf07d33-5b20-4180-aa0d-5ae17d93a661 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:04.801072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf07d33-5b20-4180-aa0d-5ae17d93a661 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:04.801344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf07d33-5b20-4180-aa0d-5ae17d93a661 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:04.839943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf07d33-5b20-4180-aa0d-5ae17d93a661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-bdf07d33-5b20-4180-aa0d-5ae17d93a661 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:04.845410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:04.846306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:04.847670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 130/260] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:04.856628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf07d33-5b20-4180-aa0d-5ae17d93a661 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:05.041985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5278675-4619-4c9d-8b2b-f8beddeac6e7 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:05.053674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:05.094351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:05.110210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf07d33-5b20-4180-aa0d-5ae17d93a661 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:05.131474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580d811-c55b-4d15-b4b1-1cab69115255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:05.131474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580d811-c55b-4d15-b4b1-1cab69115255 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:05.131474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580d811-c55b-4d15-b4b1-1cab69115255 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:05.131474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580d811-c55b-4d15-b4b1-1cab69115255 None admin] PATH_INFO: `/v3/users/99ad4a4112bc415ca043ccee221b6b85` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:05.133183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580d811-c55b-4d15-b4b1-1cab69115255 None admin] RBAC: Authorizing `identity:get_user(user_id=99ad4a4112bc415ca043ccee221b6b85)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:05.134685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580d811-c55b-4d15-b4b1-1cab69115255 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:05.141416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 131/261] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:04 2022] GET /identity/v3/users/99ad4a4112bc415ca043ccee221b6b85 => generated 283 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:05.161658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580d811-c55b-4d15-b4b1-1cab69115255 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:05.188845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:05.189972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:05.190611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:05.191223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:05.192497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:05.193078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:05.201805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:05.215087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 131/262] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:05.221852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:05.378782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580d811-c55b-4d15-b4b1-1cab69115255 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:05.443164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c2897-d72b-4c8d-8f65-61051ce088c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:05.443799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c2897-d72b-4c8d-8f65-61051ce088c1 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:05.444085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c2897-d72b-4c8d-8f65-61051ce088c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:05.444365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c2897-d72b-4c8d-8f65-61051ce088c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:05.498874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f117f-d56c-4d99-a16e-4c9e8c6e1aed None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:05.584964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:05.606557 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09320617-51b3-4436-89ef-1cc2c1b60be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:05.607289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320617-51b3-4436-89ef-1cc2c1b60be9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:05.607572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320617-51b3-4436-89ef-1cc2c1b60be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:05.607850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09320617-51b3-4436-89ef-1cc2c1b60be9 None admin] PATH_INFO: `/v3/users/99ad4a4112bc415ca043ccee221b6b85` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:05.609169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09320617-51b3-4436-89ef-1cc2c1b60be9 None admin] RBAC: Authorizing `identity:get_user(user_id=99ad4a4112bc415ca043ccee221b6b85)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:05.610682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09320617-51b3-4436-89ef-1cc2c1b60be9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:05.621430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 132/263] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:05 2022] GET /identity/v3/users/99ad4a4112bc415ca043ccee221b6b85 => generated 283 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:05.628921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09320617-51b3-4436-89ef-1cc2c1b60be9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:05.673777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:05.677964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c2897-d72b-4c8d-8f65-61051ce088c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:05.679552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c2897-d72b-4c8d-8f65-61051ce088c1 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:05.826475 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09320617-51b3-4436-89ef-1cc2c1b60be9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:05.892207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bc8ee-a845-4899-affb-7f2cc40d97e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:05.892763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc8ee-a845-4899-affb-7f2cc40d97e5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:05.893066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc8ee-a845-4899-affb-7f2cc40d97e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:05.893337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc8ee-a845-4899-affb-7f2cc40d97e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:06.006528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 132/264] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:06.014354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c2897-d72b-4c8d-8f65-61051ce088c1 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:06.089815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bc8ee-a845-4899-affb-7f2cc40d97e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:06.091329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bc8ee-a845-4899-affb-7f2cc40d97e5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:06.127690 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:06.150494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:06.166392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c2897-d72b-4c8d-8f65-61051ce088c1 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:06.228220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad912c8-322d-474b-b7e1-7ca4f62b843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:06.229499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad912c8-322d-474b-b7e1-7ca4f62b843f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:06.229805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad912c8-322d-474b-b7e1-7ca4f62b843f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:06.230087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad912c8-322d-474b-b7e1-7ca4f62b843f None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:06.233971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad912c8-322d-474b-b7e1-7ca4f62b843f None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:06.236344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad912c8-322d-474b-b7e1-7ca4f62b843f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:06.241061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 133/265] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:06 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:06.251490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad912c8-322d-474b-b7e1-7ca4f62b843f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:06.366641 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 133/266] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:06.373404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bc8ee-a845-4899-affb-7f2cc40d97e5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:06.517250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad912c8-322d-474b-b7e1-7ca4f62b843f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:06.582381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:06.583577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:06.584304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:06.585094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:06.588339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38, user.id=99ad4a4112bc415ca043ccee221b6b85) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:06.589264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:06.600921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:06.611432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 134/267] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:06 2022] GET /identity/v3/role_assignments?user.id=99ad4a4112bc415ca043ccee221b6b85&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:06.676962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bc8ee-a845-4899-affb-7f2cc40d97e5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:06.723079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:06.741828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b13646-c208-4a3e-a3b7-522347938bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:06.742516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13646-c208-4a3e-a3b7-522347938bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:06.743334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13646-c208-4a3e-a3b7-522347938bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:06.743687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13646-c208-4a3e-a3b7-522347938bd0 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:06.745258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b13646-c208-4a3e-a3b7-522347938bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:06.746796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b13646-c208-4a3e-a3b7-522347938bd0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:06.749068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 134/268] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:06 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:06.756442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:06.772562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:06.921740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb957446-6b5f-4da3-9910-77a1cab120e3 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:06.931603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3646c-c4e8-4abc-9850-2e6316670562 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:06.932392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3646c-c4e8-4abc-9850-2e6316670562 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:06.933013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3646c-c4e8-4abc-9850-2e6316670562 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:06.935404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 135/269] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:06.942588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a01e4-3303-41fa-bf0f-51cb1f68d99d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:06.943329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a01e4-3303-41fa-bf0f-51cb1f68d99d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:06.943912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a01e4-3303-41fa-bf0f-51cb1f68d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:06.974501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce058dc6-35b6-4ba3-8c84-1bcdf2eb8ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:06.975952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058dc6-35b6-4ba3-8c84-1bcdf2eb8ceb None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:06.976661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058dc6-35b6-4ba3-8c84-1bcdf2eb8ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:06.978019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058dc6-35b6-4ba3-8c84-1bcdf2eb8ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:06.979149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce058dc6-35b6-4ba3-8c84-1bcdf2eb8ceb None admin] RBAC: Adding query filter params (role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38, user.id=99ad4a4112bc415ca043ccee221b6b85) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:06.979708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce058dc6-35b6-4ba3-8c84-1bcdf2eb8ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:06.981538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce058dc6-35b6-4ba3-8c84-1bcdf2eb8ceb None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:06.995445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 135/270] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:06 2022] GET /identity/v3/role_assignments?user.id=99ad4a4112bc415ca043ccee221b6b85&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:07.002134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c31a01e4-3303-41fa-bf0f-51cb1f68d99d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:07.003782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c31a01e4-3303-41fa-bf0f-51cb1f68d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:07.011454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317ec05-29be-4128-82d9-8036cb63cb29 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.011968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317ec05-29be-4128-82d9-8036cb63cb29 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.012389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317ec05-29be-4128-82d9-8036cb63cb29 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.014314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 136/271] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:04:07.021191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82bff-aacf-4dc8-b3ce-a95452492f22 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.021728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82bff-aacf-4dc8-b3ce-a95452492f22 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.022161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82bff-aacf-4dc8-b3ce-a95452492f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.063556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b3f82bff-aacf-4dc8-b3ce-a95452492f22 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:07.064811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b3f82bff-aacf-4dc8-b3ce-a95452492f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:07.136538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 136/272] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:07.171262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a01e4-3303-41fa-bf0f-51cb1f68d99d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:07.197563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:07.202175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 137/273] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:07.203487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269911a-0390-49fa-b755-eccd3b3c47b3 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.203767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269911a-0390-49fa-b755-eccd3b3c47b3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.204035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269911a-0390-49fa-b755-eccd3b3c47b3 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.209756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 138/274] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:07.216471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2b88-46db-4a0b-8cfc-f90aed794ff0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.216737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2b88-46db-4a0b-8cfc-f90aed794ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.216963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2b88-46db-4a0b-8cfc-f90aed794ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.254056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cfcd2b88-46db-4a0b-8cfc-f90aed794ff0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:07.255500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cfcd2b88-46db-4a0b-8cfc-f90aed794ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:07.331714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a01e4-3303-41fa-bf0f-51cb1f68d99d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:07.366529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 139/275] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:07.368309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd2b88-46db-4a0b-8cfc-f90aed794ff0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:07.370853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:07.385763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef47e5-6f01-4faf-95cc-30eea6d7a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:07.386807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef47e5-6f01-4faf-95cc-30eea6d7a51b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.387258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef47e5-6f01-4faf-95cc-30eea6d7a51b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.387697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef47e5-6f01-4faf-95cc-30eea6d7a51b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.405036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef47e5-6f01-4faf-95cc-30eea6d7a51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-e4ef47e5-6f01-4faf-95cc-30eea6d7a51b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:07.412672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:07.414030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:07.415581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:07.417626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 137/276] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:07.418897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef47e5-6f01-4faf-95cc-30eea6d7a51b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:07.513630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd2b88-46db-4a0b-8cfc-f90aed794ff0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:07.562705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:07.571230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0ef29-576b-4df8-836f-b69bb3b8e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:07.572194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0ef29-576b-4df8-836f-b69bb3b8e151 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.572645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0ef29-576b-4df8-836f-b69bb3b8e151 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.578055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0ef29-576b-4df8-836f-b69bb3b8e151 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.582026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef47e5-6f01-4faf-95cc-30eea6d7a51b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:07.590055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0ef29-576b-4df8-836f-b69bb3b8e151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-7bd0ef29-576b-4df8-836f-b69bb3b8e151 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:07.600009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:07.600966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:07.601768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 140/277] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:07.603552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0ef29-576b-4df8-836f-b69bb3b8e151 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:07.638118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6c1d2-6ced-4f88-8541-89a81a72c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:07.639118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6c1d2-6ced-4f88-8541-89a81a72c878 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.639473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6c1d2-6ced-4f88-8541-89a81a72c878 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.639816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6c1d2-6ced-4f88-8541-89a81a72c878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.641444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6c1d2-6ced-4f88-8541-89a81a72c878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:07.643284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6c1d2-6ced-4f88-8541-89a81a72c878 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:07.645076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 138/278] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:07.646232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2618-5a06-4421-b79f-5cb56c8e7705 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.646540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2618-5a06-4421-b79f-5cb56c8e7705 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.646776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2618-5a06-4421-b79f-5cb56c8e7705 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.648083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 139/279] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:07.648769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b2618-5a06-4421-b79f-5cb56c8e7705 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:07.718808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:07.733714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0ef29-576b-4df8-836f-b69bb3b8e151 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:07.775717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b2618-5a06-4421-b79f-5cb56c8e7705 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:07.778646 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:07.779263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.779547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.779818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.780536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:07.780841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:07.782274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:07.794579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 141/280] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:07.796077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:07.827755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c29210-d497-4c9b-bfad-b017b559e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:07.828376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29210-d497-4c9b-bfad-b017b559e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.828659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29210-d497-4c9b-bfad-b017b559e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.829311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29210-d497-4c9b-bfad-b017b559e9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.829691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c29210-d497-4c9b-bfad-b017b559e9f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:07.829992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c29210-d497-4c9b-bfad-b017b559e9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:07.831530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c29210-d497-4c9b-bfad-b017b559e9f3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:07.841970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 140/281] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:07.843156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00871-e62e-4443-89b8-f842247495c1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:07.843473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00871-e62e-4443-89b8-f842247495c1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:07.843752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00871-e62e-4443-89b8-f842247495c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:07.862985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-62c00871-e62e-4443-89b8-f842247495c1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:07.864345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-62c00871-e62e-4443-89b8-f842247495c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:07.889272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:07.946551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 141/282] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:07.948003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c00871-e62e-4443-89b8-f842247495c1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:07.951945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4ab85-ba8d-44d9-b195-20c05c122646 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.001899 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fe8a6-5a38-4f71-8e27-046ab0646df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.002865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fe8a6-5a38-4f71-8e27-046ab0646df6 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.003314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fe8a6-5a38-4f71-8e27-046ab0646df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.003732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fe8a6-5a38-4f71-8e27-046ab0646df6 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.004590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fe8a6-5a38-4f71-8e27-046ab0646df6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.006538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fe8a6-5a38-4f71-8e27-046ab0646df6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.021148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:08.084611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c00871-e62e-4443-89b8-f842247495c1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.117020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 142/283] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:04:07 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:08.117020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fe8a6-5a38-4f71-8e27-046ab0646df6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.132333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035e500-faf1-4275-b9f3-7882d31c403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.133081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e500-faf1-4275-b9f3-7882d31c403e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.133402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e500-faf1-4275-b9f3-7882d31c403e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.133684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e500-faf1-4275-b9f3-7882d31c403e None admin] PATH_INFO: `/v3/users/3d9a86fc0a0a470a851b34d649698c2d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.151734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035e500-faf1-4275-b9f3-7882d31c403e None admin] RBAC: Authorizing `identity:get_user(user_id=3d9a86fc0a0a470a851b34d649698c2d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.153440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035e500-faf1-4275-b9f3-7882d31c403e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.155271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 142/284] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:07 2022] GET /identity/v3/users/3d9a86fc0a0a470a851b34d649698c2d => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:08.156116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035e500-faf1-4275-b9f3-7882d31c403e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.243579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fe8a6-5a38-4f71-8e27-046ab0646df6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.255810 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:08.299824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4abdcc-b490-44b3-99a2-2cf48c36133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.301589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4abdcc-b490-44b3-99a2-2cf48c36133f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.301589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4abdcc-b490-44b3-99a2-2cf48c36133f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.301589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4abdcc-b490-44b3-99a2-2cf48c36133f None admin] PATH_INFO: `/v3/users/0ffba3ec26e34676909b48cdc9e2e7ed` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.302886 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4abdcc-b490-44b3-99a2-2cf48c36133f None admin] RBAC: Authorizing `identity:get_user(user_id=0ffba3ec26e34676909b48cdc9e2e7ed)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.304372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4abdcc-b490-44b3-99a2-2cf48c36133f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.306675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 143/285] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:08 2022] GET /identity/v3/users/0ffba3ec26e34676909b48cdc9e2e7ed => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:08.307111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4abdcc-b490-44b3-99a2-2cf48c36133f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.329800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035e500-faf1-4275-b9f3-7882d31c403e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.331555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:08.394833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf494b-6196-4c41-aaee-b0444eaf1889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.395400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf494b-6196-4c41-aaee-b0444eaf1889 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.395683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf494b-6196-4c41-aaee-b0444eaf1889 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.395961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf494b-6196-4c41-aaee-b0444eaf1889 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.414050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf494b-6196-4c41-aaee-b0444eaf1889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-a4bf494b-6196-4c41-aaee-b0444eaf1889 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:08.421122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:08.422689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 143/286] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:08.424149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf494b-6196-4c41-aaee-b0444eaf1889 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.484419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4abdcc-b490-44b3-99a2-2cf48c36133f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.533040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.533754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.534028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.534295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.535186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] RBAC: Adding query filter params (role.id=59c9db9bdfff4dddb561f03e052100d2, user.id=3d9a86fc0a0a470a851b34d649698c2d, scope.system=all) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:08.535494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.536928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.543920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 144/287] 10.222.0.93 () {56 vars in 1308 bytes} [Thu Aug 4 21:04:08 2022] GET /identity/v3/role_assignments?user.id=3d9a86fc0a0a470a851b34d649698c2d&scope.system=all&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:08.544829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.579624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf494b-6196-4c41-aaee-b0444eaf1889 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.595449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:08.623908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f034862-0bfd-4d9d-8774-3bb59805eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.624578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034862-0bfd-4d9d-8774-3bb59805eb13 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.624859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034862-0bfd-4d9d-8774-3bb59805eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.625164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034862-0bfd-4d9d-8774-3bb59805eb13 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.626414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f034862-0bfd-4d9d-8774-3bb59805eb13 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.627950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f034862-0bfd-4d9d-8774-3bb59805eb13 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.630080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 144/288] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:08 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:08.639202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f034862-0bfd-4d9d-8774-3bb59805eb13 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.686958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ff2f1-d8d7-414e-a7d5-1bba6a67d0a8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.700463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:08.747102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.748348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.748757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.749443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.750644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:08.751216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.753180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.770451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 145/289] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:08.776538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.812854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f034862-0bfd-4d9d-8774-3bb59805eb13 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.856281 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dce069-f2f2-4837-82bf-75d83c231fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.856281 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce069-f2f2-4837-82bf-75d83c231fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.856281 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce069-f2f2-4837-82bf-75d83c231fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.856281 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce069-f2f2-4837-82bf-75d83c231fb0 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/users/0ffba3ec26e34676909b48cdc9e2e7ed/roles/77e9c604ddbf4af1ab9adf2ad12a4c46` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.859670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dce069-f2f2-4837-82bf-75d83c231fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=51fa6c38b60446aa9a9d93a3a3980e38, user_id=0ffba3ec26e34676909b48cdc9e2e7ed, role_id=77e9c604ddbf4af1ab9adf2ad12a4c46)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.862442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dce069-f2f2-4837-82bf-75d83c231fb0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.940086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 145/290] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:08 2022] PUT /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/users/0ffba3ec26e34676909b48cdc9e2e7ed/roles/77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:08.963104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699b2b1-8f5c-46f3-b4a2-7ab763814bae None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.965345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:09.034278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea09cc-116c-42c0-af37-d216e0fef5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:09.034949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea09cc-116c-42c0-af37-d216e0fef5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:09.035221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea09cc-116c-42c0-af37-d216e0fef5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:09.035502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea09cc-116c-42c0-af37-d216e0fef5f0 None admin] PATH_INFO: `/v3/users/8bfe31c2e7e243baa15361833dbb888e` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:09.036757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea09cc-116c-42c0-af37-d216e0fef5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=8bfe31c2e7e243baa15361833dbb888e)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:09.038408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea09cc-116c-42c0-af37-d216e0fef5f0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:09.040857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 146/291] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:08 2022] GET /identity/v3/users/8bfe31c2e7e243baa15361833dbb888e => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:09.047132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dce069-f2f2-4837-82bf-75d83c231fb0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:09.219400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:09.230993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dce069-f2f2-4837-82bf-75d83c231fb0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:09.285092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72e2b-01ff-4353-abde-4e6089781b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:09.285904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72e2b-01ff-4353-abde-4e6089781b52 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:09.286184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72e2b-01ff-4353-abde-4e6089781b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:09.286506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72e2b-01ff-4353-abde-4e6089781b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:09.453131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d72e2b-01ff-4353-abde-4e6089781b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:09.455687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d72e2b-01ff-4353-abde-4e6089781b52 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:09.638598 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:09.653512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 146/292] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:09.659536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea09cc-116c-42c0-af37-d216e0fef5f0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:09.854672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea09cc-116c-42c0-af37-d216e0fef5f0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:09.925308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c986-1f9b-4612-89e8-062c97d6c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:09.926394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c986-1f9b-4612-89e8-062c97d6c168 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:09.926879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c986-1f9b-4612-89e8-062c97d6c168 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:09.927359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c986-1f9b-4612-89e8-062c97d6c168 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:09.929529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8c986-1f9b-4612-89e8-062c97d6c168 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:09.933115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8c986-1f9b-4612-89e8-062c97d6c168 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:09.936352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 147/293] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:09 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:09.946028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72e2b-01ff-4353-abde-4e6089781b52 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.101552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72e2b-01ff-4353-abde-4e6089781b52 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.169225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb070-8b10-4c94-944f-4810538c75b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.170076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb070-8b10-4c94-944f-4810538c75b9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.170379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb070-8b10-4c94-944f-4810538c75b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.170794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb070-8b10-4c94-944f-4810538c75b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.171854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb070-8b10-4c94-944f-4810538c75b9 None admin] RBAC: Adding query filter params (role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38, user.id=8bfe31c2e7e243baa15361833dbb888e) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:10.172220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb070-8b10-4c94-944f-4810538c75b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.174276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb070-8b10-4c94-944f-4810538c75b9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.183789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 147/294] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:09 2022] GET /identity/v3/role_assignments?user.id=8bfe31c2e7e243baa15361833dbb888e&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:11.305681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8acc0e-a788-4597-ab72-0fe03c6e28ed None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.306832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8acc0e-a788-4597-ab72-0fe03c6e28ed None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.307430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8acc0e-a788-4597-ab72-0fe03c6e28ed None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.309819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 148/295] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:04:11.318246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420314-c17b-4c87-8be3-99749051b9f3 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.344747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420314-c17b-4c87-8be3-99749051b9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.344747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53420314-c17b-4c87-8be3-99749051b9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.345183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954731-d4f2-46d0-86d6-2bb381b6f627 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.345183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954731-d4f2-46d0-86d6-2bb381b6f627 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.345183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954731-d4f2-46d0-86d6-2bb381b6f627 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.345183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 149/296] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:04:11.345183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50baad-9a16-41df-a3fa-d0765b0e964d None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.345183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50baad-9a16-41df-a3fa-d0765b0e964d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.345724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50baad-9a16-41df-a3fa-d0765b0e964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.347492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-53420314-c17b-4c87-8be3-99749051b9f3 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:11.348999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-53420314-c17b-4c87-8be3-99749051b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:11.367101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3f50baad-9a16-41df-a3fa-d0765b0e964d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:11.369967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3f50baad-9a16-41df-a3fa-d0765b0e964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:11.424947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:11.434036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:11.466832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 148/297] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:11.508431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53420314-c17b-4c87-8be3-99749051b9f3 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:11.532748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 150/298] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:11.558181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50baad-9a16-41df-a3fa-d0765b0e964d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:11.722245 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53420314-c17b-4c87-8be3-99749051b9f3 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:11.760106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50baad-9a16-41df-a3fa-d0765b0e964d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:11.777626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dadd6-c55a-42c0-9440-769a9eb8090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:11.778296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dadd6-c55a-42c0-9440-769a9eb8090e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.778596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dadd6-c55a-42c0-9440-769a9eb8090e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.778856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dadd6-c55a-42c0-9440-769a9eb8090e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.780021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dadd6-c55a-42c0-9440-769a9eb8090e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:11.781530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dadd6-c55a-42c0-9440-769a9eb8090e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:11.783426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 149/299] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:11.783426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903244-b83c-493a-b1cf-c94b959bfc0a None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.783426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903244-b83c-493a-b1cf-c94b959bfc0a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.783426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903244-b83c-493a-b1cf-c94b959bfc0a None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.783426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 150/300] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:11.783426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b47f2-aa7e-4bea-86a3-c282f9ca9c2e None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.788871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b47f2-aa7e-4bea-86a3-c282f9ca9c2e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.788871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b47f2-aa7e-4bea-86a3-c282f9ca9c2e None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.790249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 151/301] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:11.791141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b47f2-aa7e-4bea-86a3-c282f9ca9c2e None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:11.814598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda432fb-4e0f-43f9-96da-71b894e8b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:11.815177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda432fb-4e0f-43f9-96da-71b894e8b045 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.815469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda432fb-4e0f-43f9-96da-71b894e8b045 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.815754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda432fb-4e0f-43f9-96da-71b894e8b045 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.829833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda432fb-4e0f-43f9-96da-71b894e8b045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-eda432fb-4e0f-43f9-96da-71b894e8b045 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:11.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:11.836074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:11.837620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 151/302] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:11.838298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e119f-ee58-4445-ac55-484c95378ada None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.838298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e119f-ee58-4445-ac55-484c95378ada None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.838298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e119f-ee58-4445-ac55-484c95378ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.858043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:11.864003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4b1e119f-ee58-4445-ac55-484c95378ada None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:11.865566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4b1e119f-ee58-4445-ac55-484c95378ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:11.893668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:11.914175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b47f2-aa7e-4bea-86a3-c282f9ca9c2e None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:11.946491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 152/303] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:11.947900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3de5-48f4-4e16-927d-103bc8ca415c None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.948158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3de5-48f4-4e16-927d-103bc8ca415c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.948427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3de5-48f4-4e16-927d-103bc8ca415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.960307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4d124-054b-43e6-890c-1f73b496f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:11.961162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4d124-054b-43e6-890c-1f73b496f599 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.962222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4d124-054b-43e6-890c-1f73b496f599 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.962653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4d124-054b-43e6-890c-1f73b496f599 None admin] PATH_INFO: `/v3/groups` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.963762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4d124-054b-43e6-890c-1f73b496f599 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:11.965603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4d124-054b-43e6-890c-1f73b496f599 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:11.976530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9bed3de5-48f4-4e16-927d-103bc8ca415c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:11.981477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9bed3de5-48f4-4e16-927d-103bc8ca415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:12.057963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 153/304] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:12.058812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3de5-48f4-4e16-927d-103bc8ca415c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:12.081002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 152/305] 10.222.0.93 () {60 vars in 1134 bytes} [Thu Aug 4 21:04:11 2022] POST /identity/v3/groups => generated 229 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:12.081002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4d124-054b-43e6-890c-1f73b496f599 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:12.210680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:12.229434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3de5-48f4-4e16-927d-103bc8ca415c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:12.255793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4d124-054b-43e6-890c-1f73b496f599 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:12.280574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:12.281466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:12.282527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:12.282527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:12.282712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:12.282961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:12.283667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:12.285941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:12.296079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 154/306] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:12.296971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:12.330052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642f23-355a-4777-9de1-b44a02730d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:12.331352 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642f23-355a-4777-9de1-b44a02730d3d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:12.331733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642f23-355a-4777-9de1-b44a02730d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:12.332542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642f23-355a-4777-9de1-b44a02730d3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:12.358037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed642f23-355a-4777-9de1-b44a02730d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-ed642f23-355a-4777-9de1-b44a02730d3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:12.368775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:12.370935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 153/307] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:12.373302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642f23-355a-4777-9de1-b44a02730d3d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:12.482736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725245-8aeb-4c86-8887-d0a9a22b621d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:12.534883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642f23-355a-4777-9de1-b44a02730d3d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:12.540703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c9a54-e3c8-4f55-a928-e20d2318c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:12.541775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c9a54-e3c8-4f55-a928-e20d2318c6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:12.542185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c9a54-e3c8-4f55-a928-e20d2318c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:12.542554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c9a54-e3c8-4f55-a928-e20d2318c6b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:12.561581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c9a54-e3c8-4f55-a928-e20d2318c6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-4c9c9a54-e3c8-4f55-a928-e20d2318c6b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:12.569913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:12.572146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:12.572982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 155/308] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:12.578159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c9a54-e3c8-4f55-a928-e20d2318c6b8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:12.590145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6c996-14da-4d67-a6ab-5d56e54f31f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:12.590445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c996-14da-4d67-a6ab-5d56e54f31f3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:12.590714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c996-14da-4d67-a6ab-5d56e54f31f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:12.591005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c996-14da-4d67-a6ab-5d56e54f31f3 None admin] PATH_INFO: `/v3/users/df414bf6d05743f5a46f149bd98eed7b` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:12.596522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:12.611169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6c996-14da-4d67-a6ab-5d56e54f31f3 None admin] RBAC: Authorizing `identity:get_user(user_id=df414bf6d05743f5a46f149bd98eed7b)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:12.613021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6c996-14da-4d67-a6ab-5d56e54f31f3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:12.620956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 154/309] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:12 2022] GET /identity/v3/users/df414bf6d05743f5a46f149bd98eed7b => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:12.622049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6c996-14da-4d67-a6ab-5d56e54f31f3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:12.666738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:12.724287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c9a54-e3c8-4f55-a928-e20d2318c6b8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:12.773583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:12.774798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:12.775126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:12.775548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:12.776473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:12.776731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:12.778347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:12.779794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6c996-14da-4d67-a6ab-5d56e54f31f3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:12.788160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 156/310] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:12.789180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:12.839625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:12.840327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:12.840533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:12.840805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:12.841551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] RBAC: Adding query filter params (name=member) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:12.841850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:12.843236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:12.862619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 155/311] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:12.863482 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:12.907841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:12.950513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e2a6-d21b-4d5d-b1f7-1b7b2f7b9437 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:12.990799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:12.991656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:12.992003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:12.992385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:12.993988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] RBAC: Adding query filter params (role.id=77e9c604ddbf4af1ab9adf2ad12a4c46, user.id=df414bf6d05743f5a46f149bd98eed7b, scope.system=all) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:12.994292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:12.995725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:13.012924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 157/312] 10.222.0.93 () {56 vars in 1308 bytes} [Thu Aug 4 21:04:12 2022] GET /identity/v3/role_assignments?user.id=df414bf6d05743f5a46f149bd98eed7b&scope.system=all&role.id=77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:13.012924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:13.016483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:13.028905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbfe8-c00e-4c80-9baa-2eb03de538df None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:13.098189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a91c6-28fb-404e-baec-2627198a49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:13.099131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a91c6-28fb-404e-baec-2627198a49a0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:13.099412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a91c6-28fb-404e-baec-2627198a49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:13.099718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a91c6-28fb-404e-baec-2627198a49a0 None admin] PATH_INFO: `/v3/users/0ffba3ec26e34676909b48cdc9e2e7ed` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:13.102525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a91c6-28fb-404e-baec-2627198a49a0 None admin] RBAC: Authorizing `identity:get_user(user_id=0ffba3ec26e34676909b48cdc9e2e7ed)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:13.104655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a91c6-28fb-404e-baec-2627198a49a0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:13.108307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 156/313] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:12 2022] GET /identity/v3/users/0ffba3ec26e34676909b48cdc9e2e7ed => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:13.116046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a91c6-28fb-404e-baec-2627198a49a0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:13.179427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c6b30-e500-4401-87f0-861ce6d90beb None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:13.235763 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0a328-e0cf-4454-b0f0-b878312d941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:13.236423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0a328-e0cf-4454-b0f0-b878312d941e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:13.236701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0a328-e0cf-4454-b0f0-b878312d941e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:13.237000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0a328-e0cf-4454-b0f0-b878312d941e None admin] PATH_INFO: `/v3/users/3d9a86fc0a0a470a851b34d649698c2d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:13.238225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0a328-e0cf-4454-b0f0-b878312d941e None admin] RBAC: Authorizing `identity:get_user(user_id=3d9a86fc0a0a470a851b34d649698c2d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:13.239684 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0a328-e0cf-4454-b0f0-b878312d941e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:13.241357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 158/314] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:13 2022] GET /identity/v3/users/3d9a86fc0a0a470a851b34d649698c2d => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:13.248072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0a328-e0cf-4454-b0f0-b878312d941e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:13.252100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:13.265724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a91c6-28fb-404e-baec-2627198a49a0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:13.310741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8016c1-2d1f-4480-b706-25363953b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:13.311382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8016c1-2d1f-4480-b706-25363953b39b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:13.311663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8016c1-2d1f-4480-b706-25363953b39b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:13.311936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8016c1-2d1f-4480-b706-25363953b39b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:13.355507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:13.412593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8016c1-2d1f-4480-b706-25363953b39b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:13.416352 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8016c1-2d1f-4480-b706-25363953b39b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:13.428039 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0a328-e0cf-4454-b0f0-b878312d941e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:13.466906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88bd02-c233-4c55-9787-0247e7f5e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:13.467959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88bd02-c233-4c55-9787-0247e7f5e368 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:13.468381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88bd02-c233-4c55-9787-0247e7f5e368 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:13.468797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88bd02-c233-4c55-9787-0247e7f5e368 None admin] PATH_INFO: `/v3/system/users/3d9a86fc0a0a470a851b34d649698c2d/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:13.470583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88bd02-c233-4c55-9787-0247e7f5e368 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d9a86fc0a0a470a851b34d649698c2d, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:13.472099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88bd02-c233-4c55-9787-0247e7f5e368 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:13.552939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 157/315] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:13.560599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8016c1-2d1f-4480-b706-25363953b39b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:13.584591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 159/316] 10.222.0.93 () {58 vars in 1334 bytes} [Thu Aug 4 21:04:13 2022] PUT /identity/v3/system/users/3d9a86fc0a0a470a851b34d649698c2d/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:13.643908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:13.709100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8016c1-2d1f-4480-b706-25363953b39b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:13.756003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537b475-eadb-412e-9130-5971bc280738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:13.756658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b475-eadb-412e-9130-5971bc280738 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:13.756953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b475-eadb-412e-9130-5971bc280738 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:13.757224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b475-eadb-412e-9130-5971bc280738 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:13.758807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537b475-eadb-412e-9130-5971bc280738 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:13.760337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537b475-eadb-412e-9130-5971bc280738 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:13.762103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 158/317] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:13 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:13.768638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88bd02-c233-4c55-9787-0247e7f5e368 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:13.847047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:13.886415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88bd02-c233-4c55-9787-0247e7f5e368 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:13.926046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd942395-c7ae-47d8-a6f0-1e11d90b25de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:13.926584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942395-c7ae-47d8-a6f0-1e11d90b25de None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:13.926909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942395-c7ae-47d8-a6f0-1e11d90b25de None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:13.927182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942395-c7ae-47d8-a6f0-1e11d90b25de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:13.928028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd942395-c7ae-47d8-a6f0-1e11d90b25de None admin] RBAC: Adding query filter params (role.id=77e9c604ddbf4af1ab9adf2ad12a4c46, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38, user.id=0ffba3ec26e34676909b48cdc9e2e7ed) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:13.928585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd942395-c7ae-47d8-a6f0-1e11d90b25de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:13.931531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd942395-c7ae-47d8-a6f0-1e11d90b25de None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:13.938525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 160/318] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:13 2022] GET /identity/v3/role_assignments?user.id=0ffba3ec26e34676909b48cdc9e2e7ed&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:14.340645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1189-cbfc-43bf-80a1-67b5de9caeb6 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:14.341182 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1189-cbfc-43bf-80a1-67b5de9caeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:14.341668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1189-cbfc-43bf-80a1-67b5de9caeb6 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:14.344201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 159/319] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:14.351018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9e501-8d80-4440-806d-c9d1fff23262 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:14.351308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9e501-8d80-4440-806d-c9d1fff23262 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:14.351588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9e501-8d80-4440-806d-c9d1fff23262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:14.373451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-eda9e501-8d80-4440-806d-c9d1fff23262 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:14.374727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-eda9e501-8d80-4440-806d-c9d1fff23262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:14.459621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 161/320] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:14.483119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb1189-cbfc-43bf-80a1-67b5de9caeb6 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:14.597984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb1189-cbfc-43bf-80a1-67b5de9caeb6 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:14.627327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:14.636451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d1d79-a8e8-4758-b692-dbedf2c8f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:14.637180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1d79-a8e8-4758-b692-dbedf2c8f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:14.637462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1d79-a8e8-4758-b692-dbedf2c8f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:14.637730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1d79-a8e8-4758-b692-dbedf2c8f5b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:14.641003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d1d79-a8e8-4758-b692-dbedf2c8f5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:14.641003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d1d79-a8e8-4758-b692-dbedf2c8f5b5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:14.642187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 160/321] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:14.648293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9e501-8d80-4440-806d-c9d1fff23262 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:14.724510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:14.770980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9e501-8d80-4440-806d-c9d1fff23262 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:14.815904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856cacb-8e03-4e2d-b078-b93068669b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:14.816533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856cacb-8e03-4e2d-b078-b93068669b00 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:14.816811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856cacb-8e03-4e2d-b078-b93068669b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:14.817113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856cacb-8e03-4e2d-b078-b93068669b00 None admin] PATH_INFO: `/v3/groups` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:14.817788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856cacb-8e03-4e2d-b078-b93068669b00 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:14.819264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856cacb-8e03-4e2d-b078-b93068669b00 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:14.950179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 162/322] 10.222.0.93 () {60 vars in 1134 bytes} [Thu Aug 4 21:04:14 2022] POST /identity/v3/groups => generated 226 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:15.314189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c9f63-6304-46e8-ad6c-25737da20b1b None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.314571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c9f63-6304-46e8-ad6c-25737da20b1b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.314764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c9f63-6304-46e8-ad6c-25737da20b1b None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.325415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 161/323] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:15.325625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aa2c-d6e9-403d-8dfe-8335bfdd49c6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.325625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aa2c-d6e9-403d-8dfe-8335bfdd49c6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.325625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aa2c-d6e9-403d-8dfe-8335bfdd49c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.345796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2ac7aa2c-d6e9-403d-8dfe-8335bfdd49c6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:15.347593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2ac7aa2c-d6e9-403d-8dfe-8335bfdd49c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:15.443702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 163/324] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:15.481198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c9f63-6304-46e8-ad6c-25737da20b1b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:15.611706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c9f63-6304-46e8-ad6c-25737da20b1b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:15.660984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd7781-c83c-40b1-92ac-d5768de27488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:15.661668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7781-c83c-40b1-92ac-d5768de27488 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.661948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7781-c83c-40b1-92ac-d5768de27488 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.662222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7781-c83c-40b1-92ac-d5768de27488 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.677602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd7781-c83c-40b1-92ac-d5768de27488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-a7fd7781-c83c-40b1-92ac-d5768de27488 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:15.683328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:15.684240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:15.685060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 162/325] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:15.690959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7aa2c-d6e9-403d-8dfe-8335bfdd49c6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:15.770495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:15.829098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7aa2c-d6e9-403d-8dfe-8335bfdd49c6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:15.851191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a824-c46b-406f-87d2-a1ccd18ced92 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.851669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a824-c46b-406f-87d2-a1ccd18ced92 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.852817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a824-c46b-406f-87d2-a1ccd18ced92 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.855261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 163/326] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:15.862126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f236-e1fe-423e-aa52-0e810ae47060 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.862476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f236-e1fe-423e-aa52-0e810ae47060 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.862926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f236-e1fe-423e-aa52-0e810ae47060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.896849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:15.897516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.897789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.898063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.899508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:15.899822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:15.901414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:15.906634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-e764f236-e1fe-423e-aa52-0e810ae47060 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:15.908877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e764f236-e1fe-423e-aa52-0e810ae47060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:15.912309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 164/327] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:15.921455 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.023876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:16.074747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 164/328] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:16.099323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f236-e1fe-423e-aa52-0e810ae47060 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.147769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96391f99-6b86-456b-b042-e8e537f54521 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.195077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:16.264820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f236-e1fe-423e-aa52-0e810ae47060 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.294574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e84c88-eeef-42e3-a8f1-93af1a71b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.295235 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e84c88-eeef-42e3-a8f1-93af1a71b16e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.295510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e84c88-eeef-42e3-a8f1-93af1a71b16e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.295776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e84c88-eeef-42e3-a8f1-93af1a71b16e None admin] PATH_INFO: `/v3/users/df414bf6d05743f5a46f149bd98eed7b` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.297035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e84c88-eeef-42e3-a8f1-93af1a71b16e None admin] RBAC: Authorizing `identity:get_user(user_id=df414bf6d05743f5a46f149bd98eed7b)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.298494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e84c88-eeef-42e3-a8f1-93af1a71b16e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.300434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 165/329] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:15 2022] GET /identity/v3/users/df414bf6d05743f5a46f149bd98eed7b => generated 293 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:16.306986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e84c88-eeef-42e3-a8f1-93af1a71b16e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.312279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba085b0-3f6d-45cf-ad21-3441d0b0398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.313329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba085b0-3f6d-45cf-ad21-3441d0b0398f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.313988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba085b0-3f6d-45cf-ad21-3441d0b0398f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.314513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba085b0-3f6d-45cf-ad21-3441d0b0398f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.330157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba085b0-3f6d-45cf-ad21-3441d0b0398f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-bba085b0-3f6d-45cf-ad21-3441d0b0398f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:16.336525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:16.338151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:16.339155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:16.341673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 165/330] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:16.349380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba085b0-3f6d-45cf-ad21-3441d0b0398f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.473355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:16.532312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e84c88-eeef-42e3-a8f1-93af1a71b16e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.553305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba085b0-3f6d-45cf-ad21-3441d0b0398f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.594191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46e1d1-3036-41a0-91af-ea4ad933d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.595736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46e1d1-3036-41a0-91af-ea4ad933d629 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.596611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46e1d1-3036-41a0-91af-ea4ad933d629 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.597384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46e1d1-3036-41a0-91af-ea4ad933d629 None admin] PATH_INFO: `/v3/system/users/df414bf6d05743f5a46f149bd98eed7b/roles/77e9c604ddbf4af1ab9adf2ad12a4c46` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.605983 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46e1d1-3036-41a0-91af-ea4ad933d629 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=df414bf6d05743f5a46f149bd98eed7b, role_id=77e9c604ddbf4af1ab9adf2ad12a4c46)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.607828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46e1d1-3036-41a0-91af-ea4ad933d629 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.614921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.615703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.615835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.616174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.616795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:16.617178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.619387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.640239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 166/331] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:16.645831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.675053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 166/332] 10.222.0.93 () {58 vars in 1334 bytes} [Thu Aug 4 21:04:16 2022] PUT /identity/v3/system/users/df414bf6d05743f5a46f149bd98eed7b/roles/77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:16.798494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092ffb4-7cee-4bcd-bcd5-6caa362e06a7 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.813665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:16.852905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe34a37-3d9d-482c-8a2d-88b1fb47ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.853843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34a37-3d9d-482c-8a2d-88b1fb47ad21 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.854196 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34a37-3d9d-482c-8a2d-88b1fb47ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.854464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34a37-3d9d-482c-8a2d-88b1fb47ad21 None admin] PATH_INFO: `/v3/users/3d9a86fc0a0a470a851b34d649698c2d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.857824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe34a37-3d9d-482c-8a2d-88b1fb47ad21 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9a86fc0a0a470a851b34d649698c2d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.860186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe34a37-3d9d-482c-8a2d-88b1fb47ad21 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.862354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 167/333] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:16 2022] GET /identity/v3/users/3d9a86fc0a0a470a851b34d649698c2d => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:16.869114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46e1d1-3036-41a0-91af-ea4ad933d629 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.955992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:17.055850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46e1d1-3036-41a0-91af-ea4ad933d629 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:17.105880 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56854484-19f1-4af6-b272-e9b3790e9987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:17.106534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854484-19f1-4af6-b272-e9b3790e9987 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:17.106813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854484-19f1-4af6-b272-e9b3790e9987 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:17.107104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854484-19f1-4af6-b272-e9b3790e9987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:17.107897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56854484-19f1-4af6-b272-e9b3790e9987 None admin] RBAC: Adding query filter params (role.id=59c9db9bdfff4dddb561f03e052100d2, user.id=3d9a86fc0a0a470a851b34d649698c2d, scope.system=all) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:17.108213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56854484-19f1-4af6-b272-e9b3790e9987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:17.109766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56854484-19f1-4af6-b272-e9b3790e9987 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:17.126560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 167/334] 10.222.0.93 () {56 vars in 1308 bytes} [Thu Aug 4 21:04:16 2022] GET /identity/v3/role_assignments?user.id=3d9a86fc0a0a470a851b34d649698c2d&scope.system=all&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:17.837476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e366-29ce-4905-9250-8071c067fe48 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:17.838616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e366-29ce-4905-9250-8071c067fe48 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:17.839204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e366-29ce-4905-9250-8071c067fe48 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:17.840957 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 168/335] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:17.863764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a519500-497d-4050-8969-3520050dd6a8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:17.864263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a519500-497d-4050-8969-3520050dd6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:17.864465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a519500-497d-4050-8969-3520050dd6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:17.893931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-8a519500-497d-4050-8969-3520050dd6a8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:17.895161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8a519500-497d-4050-8969-3520050dd6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:18.006723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 168/336] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:18.092753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e366-29ce-4905-9250-8071c067fe48 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:18.311765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e366-29ce-4905-9250-8071c067fe48 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:18.384876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb50de-e107-465b-9e2b-eea2a275a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:18.385479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb50de-e107-465b-9e2b-eea2a275a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:18.385764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb50de-e107-465b-9e2b-eea2a275a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:18.386041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb50de-e107-465b-9e2b-eea2a275a2b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:18.404827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb50de-e107-465b-9e2b-eea2a275a2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-1fbb50de-e107-465b-9e2b-eea2a275a2b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:18.410969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:18.412587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:18.414778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 169/337] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:18.425965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a519500-497d-4050-8969-3520050dd6a8 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:18.509750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:18.652237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a519500-497d-4050-8969-3520050dd6a8 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:18.723351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb6038-3d30-41fe-8071-1f616d289e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:18.724380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb6038-3d30-41fe-8071-1f616d289e23 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:18.724833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb6038-3d30-41fe-8071-1f616d289e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:18.725322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb6038-3d30-41fe-8071-1f616d289e23 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:18.726525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb6038-3d30-41fe-8071-1f616d289e23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:18.728059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb6038-3d30-41fe-8071-1f616d289e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:18.730270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb6038-3d30-41fe-8071-1f616d289e23 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:18.752537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 169/338] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:18.761912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb50de-e107-465b-9e2b-eea2a275a2b1 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:18.830150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:18.926930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb50de-e107-465b-9e2b-eea2a275a2b1 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:18.939822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1dd9-30dc-48aa-8db9-bd4d8fa53d81 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:18.940610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1dd9-30dc-48aa-8db9-bd4d8fa53d81 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:18.940610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1dd9-30dc-48aa-8db9-bd4d8fa53d81 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:18.942073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 170/339] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:18.947816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90315b51-2ad4-4d18-957e-1cf087170522 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:18.948174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90315b51-2ad4-4d18-957e-1cf087170522 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:18.948428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90315b51-2ad4-4d18-957e-1cf087170522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:18.982749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-90315b51-2ad4-4d18-957e-1cf087170522 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:18.983951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-90315b51-2ad4-4d18-957e-1cf087170522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:18.998719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998eb9-0487-4a1b-8a31-008fd55fd0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:18.999473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998eb9-0487-4a1b-8a31-008fd55fd0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:18.999808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998eb9-0487-4a1b-8a31-008fd55fd0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:19.000111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998eb9-0487-4a1b-8a31-008fd55fd0c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:19.153118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 171/340] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:19.184246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90315b51-2ad4-4d18-957e-1cf087170522 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:19.184963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea998eb9-0487-4a1b-8a31-008fd55fd0c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:19.190872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea998eb9-0487-4a1b-8a31-008fd55fd0c9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:19.284985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:19.311574 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:19.433062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90315b51-2ad4-4d18-957e-1cf087170522 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:19.560492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 170/341] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 799 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:19.568816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998eb9-0487-4a1b-8a31-008fd55fd0c9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:19.571373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d577-7c60-416a-aafe-0e37254b91dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:19.572685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d577-7c60-416a-aafe-0e37254b91dc None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:19.573156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d577-7c60-416a-aafe-0e37254b91dc None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:19.573443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d577-7c60-416a-aafe-0e37254b91dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:19.591095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371d577-7c60-416a-aafe-0e37254b91dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-9371d577-7c60-416a-aafe-0e37254b91dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:19.601273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:19.603979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:19.607279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 172/342] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:19.613132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d577-7c60-416a-aafe-0e37254b91dc None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:19.729267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:19.748875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d577-7c60-416a-aafe-0e37254b91dc None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:19.791099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:19.791836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:19.792115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:19.792579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:19.793586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:19.793968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:19.795695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:19.806280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 173/343] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:19.812410 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:19.894129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998eb9-0487-4a1b-8a31-008fd55fd0c9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:19.965967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31ea4d-d4bb-4731-aca5-5af1231ec85e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:19.987254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690664bd-7696-457d-ae25-b147deab8d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:19.988053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690664bd-7696-457d-ae25-b147deab8d83 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:19.988379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690664bd-7696-457d-ae25-b147deab8d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:19.988536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690664bd-7696-457d-ae25-b147deab8d83 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:19.989848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690664bd-7696-457d-ae25-b147deab8d83 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:19.991669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690664bd-7696-457d-ae25-b147deab8d83 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:20.001096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 171/344] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:19 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:20.002359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690664bd-7696-457d-ae25-b147deab8d83 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:20.009433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543feb1-9f3f-4259-9a43-bc955ee1441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:20.010144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543feb1-9f3f-4259-9a43-bc955ee1441f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.010455 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543feb1-9f3f-4259-9a43-bc955ee1441f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.010790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543feb1-9f3f-4259-9a43-bc955ee1441f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.018425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:20.036104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:20.100200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543feb1-9f3f-4259-9a43-bc955ee1441f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:20.102326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543feb1-9f3f-4259-9a43-bc955ee1441f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:20.237117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 174/345] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:20.238738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543feb1-9f3f-4259-9a43-bc955ee1441f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:20.262266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690664bd-7696-457d-ae25-b147deab8d83 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:20.296151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:20.328724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a441-1a06-4588-bd0b-d0348027d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:20.329809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a441-1a06-4588-bd0b-d0348027d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.330491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a441-1a06-4588-bd0b-d0348027d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.330985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a441-1a06-4588-bd0b-d0348027d7e7 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.342368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28a441-1a06-4588-bd0b-d0348027d7e7 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:20.345174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28a441-1a06-4588-bd0b-d0348027d7e7 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:20.348648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 172/346] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:20 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:20.353216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cc478-7b4e-43d2-b0df-b9af68ca3265 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.353600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cc478-7b4e-43d2-b0df-b9af68ca3265 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.354066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cc478-7b4e-43d2-b0df-b9af68ca3265 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.356910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 173/347] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:20.360388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543feb1-9f3f-4259-9a43-bc955ee1441f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:20.361823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cc478-7b4e-43d2-b0df-b9af68ca3265 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:20.405776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215e00c-fc3b-4a94-b79a-0410aa22a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:20.406595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215e00c-fc3b-4a94-b79a-0410aa22a9da None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.406845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215e00c-fc3b-4a94-b79a-0410aa22a9da None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.407071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215e00c-fc3b-4a94-b79a-0410aa22a9da None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.408506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215e00c-fc3b-4a94-b79a-0410aa22a9da None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:20.410304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215e00c-fc3b-4a94-b79a-0410aa22a9da None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:20.412783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 175/348] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:20 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:20.417345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f59ab-f9dd-4d5b-8a0a-ec18e707767a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.417675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f59ab-f9dd-4d5b-8a0a-ec18e707767a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.418009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f59ab-f9dd-4d5b-8a0a-ec18e707767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.442831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ad4f59ab-f9dd-4d5b-8a0a-ec18e707767a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:20.444142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ad4f59ab-f9dd-4d5b-8a0a-ec18e707767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:20.495071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:20.525976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 176/349] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:20.526853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f59ab-f9dd-4d5b-8a0a-ec18e707767a None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:20.580233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:20.599051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cc478-7b4e-43d2-b0df-b9af68ca3265 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:20.645929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f59ab-f9dd-4d5b-8a0a-ec18e707767a None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:20.687448 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744397-400f-445e-aeee-72cb367e2a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:20.688123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744397-400f-445e-aeee-72cb367e2a94 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.688406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744397-400f-445e-aeee-72cb367e2a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.688680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744397-400f-445e-aeee-72cb367e2a94 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.690137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744397-400f-445e-aeee-72cb367e2a94 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:20.691609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744397-400f-445e-aeee-72cb367e2a94 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:20.693290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 177/350] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:20 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:20.694079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744397-400f-445e-aeee-72cb367e2a94 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:20.707860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:20.709366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.710114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.715600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.717745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] RBAC: Adding query filter params (group.id=fda96d73eab44b46bcce19b6355b8edf, role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=81c7e412e96f4fadaa334b907d4734e7) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:20.718593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:20.721657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:20.746366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 174/351] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:20 2022] GET /identity/v3/role_assignments?group.id=fda96d73eab44b46bcce19b6355b8edf&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 260 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:20.747529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:20.818474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744397-400f-445e-aeee-72cb367e2a94 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:20.835539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:20.860139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e074-8b41-4419-81bf-f6fac7e8ef09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:20.860933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e074-8b41-4419-81bf-f6fac7e8ef09 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.861220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e074-8b41-4419-81bf-f6fac7e8ef09 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.861496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e074-8b41-4419-81bf-f6fac7e8ef09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.875036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39e074-8b41-4419-81bf-f6fac7e8ef09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-4e39e074-8b41-4419-81bf-f6fac7e8ef09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:20.880289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:20.881332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:20.882143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 178/352] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:20.885145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0659-18e7-4f39-b3b5-31cdaee8cc1e None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:20.885431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0659-18e7-4f39-b3b5-31cdaee8cc1e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:20.885707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0659-18e7-4f39-b3b5-31cdaee8cc1e None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:20.887525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 179/353] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:20.890412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0659-18e7-4f39-b3b5-31cdaee8cc1e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:20.988623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e8094-6b1b-4596-9378-bc2b10b6c357 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.060379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:21.069013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b57da-a8cd-4508-86ce-90eb8f3ac679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.071262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b57da-a8cd-4508-86ce-90eb8f3ac679 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.071635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b57da-a8cd-4508-86ce-90eb8f3ac679 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.071925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b57da-a8cd-4508-86ce-90eb8f3ac679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.072826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b57da-a8cd-4508-86ce-90eb8f3ac679 None admin] RBAC: Adding query filter params (group.id=fda96d73eab44b46bcce19b6355b8edf, role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=81c7e412e96f4fadaa334b907d4734e7) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:21.074546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b57da-a8cd-4508-86ce-90eb8f3ac679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:21.076796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b57da-a8cd-4508-86ce-90eb8f3ac679 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:21.085544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 175/354] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:20 2022] GET /identity/v3/role_assignments?group.id=fda96d73eab44b46bcce19b6355b8edf&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 260 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:21.087228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065dfe-4e4c-4089-8990-04b16d092a7a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.087731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065dfe-4e4c-4089-8990-04b16d092a7a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.088225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065dfe-4e4c-4089-8990-04b16d092a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.093535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0659-18e7-4f39-b3b5-31cdaee8cc1e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.118954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-31065dfe-4e4c-4089-8990-04b16d092a7a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:21.121017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-31065dfe-4e4c-4089-8990-04b16d092a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:21.178642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.179339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.179766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.180034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.180967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:21.181275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:21.183138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:21.210355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 180/355] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:21.215564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:21.266970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 176/356] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:21.282924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:21.303829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31065dfe-4e4c-4089-8990-04b16d092a7a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:21.359851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec37390-f1ad-458c-b305-c9f95371327c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.398606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5abc96-b92d-4a74-b828-4d85417cb3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.400295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5abc96-b92d-4a74-b828-4d85417cb3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.400822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5abc96-b92d-4a74-b828-4d85417cb3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.401273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5abc96-b92d-4a74-b828-4d85417cb3b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.469407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31065dfe-4e4c-4089-8990-04b16d092a7a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.485882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5abc96-b92d-4a74-b828-4d85417cb3b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:21.487588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5abc96-b92d-4a74-b828-4d85417cb3b5 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:21.517390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:21.529099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:21.530857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e12c-4063-41c6-b432-28c0f2df14b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.536835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e12c-4063-41c6-b432-28c0f2df14b5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.536835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e12c-4063-41c6-b432-28c0f2df14b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.536835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e12c-4063-41c6-b432-28c0f2df14b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.549271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e12c-4063-41c6-b432-28c0f2df14b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-c353e12c-4063-41c6-b432-28c0f2df14b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:21.561401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:21.562355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:21.563144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 177/357] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:21.568810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e12c-4063-41c6-b432-28c0f2df14b5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:21.604936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 181/358] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:21.615712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5abc96-b92d-4a74-b828-4d85417cb3b5 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:21.717230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e12c-4063-41c6-b432-28c0f2df14b5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.756943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217b1f4-dd89-4b17-aafd-98fd2556bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.757671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217b1f4-dd89-4b17-aafd-98fd2556bd41 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.758150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217b1f4-dd89-4b17-aafd-98fd2556bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.758426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217b1f4-dd89-4b17-aafd-98fd2556bd41 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.759197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5abc96-b92d-4a74-b828-4d85417cb3b5 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.759488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217b1f4-dd89-4b17-aafd-98fd2556bd41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:21.759793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217b1f4-dd89-4b17-aafd-98fd2556bd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:21.761222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217b1f4-dd89-4b17-aafd-98fd2556bd41 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:21.771252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 178/359] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:21.772726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592f3b5-76cb-4380-bfb6-32c4c2c0a106 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.773065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592f3b5-76cb-4380-bfb6-32c4c2c0a106 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.774180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592f3b5-76cb-4380-bfb6-32c4c2c0a106 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.775821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 179/360] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:21.776943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db6e6a-ab41-40f1-a1bf-7da0aa0c3084 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.777228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db6e6a-ab41-40f1-a1bf-7da0aa0c3084 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.777738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db6e6a-ab41-40f1-a1bf-7da0aa0c3084 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.779177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 180/361] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:21.779907 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db6e6a-ab41-40f1-a1bf-7da0aa0c3084 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:21.803957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95f84-86a6-42cc-82c3-abde7fa1e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.805137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95f84-86a6-42cc-82c3-abde7fa1e992 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.805434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95f84-86a6-42cc-82c3-abde7fa1e992 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.805692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95f84-86a6-42cc-82c3-abde7fa1e992 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.806934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a95f84-86a6-42cc-82c3-abde7fa1e992 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:21.808674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a95f84-86a6-42cc-82c3-abde7fa1e992 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:21.810556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 182/362] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:21 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:21.811811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea243-30d7-4e9e-9187-6ffabf772e59 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.812097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea243-30d7-4e9e-9187-6ffabf772e59 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.812370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea243-30d7-4e9e-9187-6ffabf772e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.821365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:21.835762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0bdea243-30d7-4e9e-9187-6ffabf772e59 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:21.838201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0bdea243-30d7-4e9e-9187-6ffabf772e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:21.843004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:21.909554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db6e6a-ab41-40f1-a1bf-7da0aa0c3084 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.939170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 183/363] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:21.945090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062b06-91fc-42ad-838a-597471203146 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.946021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062b06-91fc-42ad-838a-597471203146 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.946675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062b06-91fc-42ad-838a-597471203146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.951696 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ad14-85a8-4090-91af-737d8d0dd16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.952336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ad14-85a8-4090-91af-737d8d0dd16a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.952613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ad14-85a8-4090-91af-737d8d0dd16a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.952898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ad14-85a8-4090-91af-737d8d0dd16a None admin] PATH_INFO: `/v3/users/df414bf6d05743f5a46f149bd98eed7b` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.954087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765ad14-85a8-4090-91af-737d8d0dd16a None admin] RBAC: Authorizing `identity:get_user(user_id=df414bf6d05743f5a46f149bd98eed7b)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:21.960904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765ad14-85a8-4090-91af-737d8d0dd16a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:21.960904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 181/364] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:04:21 2022] GET /identity/v3/users/df414bf6d05743f5a46f149bd98eed7b => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:21.960904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ad14-85a8-4090-91af-737d8d0dd16a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:21.982207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-86062b06-91fc-42ad-838a-597471203146 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:21.983815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-86062b06-91fc-42ad-838a-597471203146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:22.081127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 184/365] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:22.082587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86062b06-91fc-42ad-838a-597471203146 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:22.090646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ad14-85a8-4090-91af-737d8d0dd16a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:22.114728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:22.136708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73386b-c6c7-41e0-974a-6eb65d7f3d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:22.137763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73386b-c6c7-41e0-974a-6eb65d7f3d12 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:22.138259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73386b-c6c7-41e0-974a-6eb65d7f3d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:22.138745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73386b-c6c7-41e0-974a-6eb65d7f3d12 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:22.140135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73386b-c6c7-41e0-974a-6eb65d7f3d12 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:22.141939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73386b-c6c7-41e0-974a-6eb65d7f3d12 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:22.144213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 182/366] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:21 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:22.145237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73386b-c6c7-41e0-974a-6eb65d7f3d12 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:22.174147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:22.225987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86062b06-91fc-42ad-838a-597471203146 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:22.274675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:22.275343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:22.275618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:22.275888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:22.276985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] RBAC: Adding query filter params (role.id=77e9c604ddbf4af1ab9adf2ad12a4c46, user.id=df414bf6d05743f5a46f149bd98eed7b, scope.system=all) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:22.277292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:22.278939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:22.279323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73386b-c6c7-41e0-974a-6eb65d7f3d12 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:22.298061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 185/367] 10.222.0.93 () {56 vars in 1308 bytes} [Thu Aug 4 21:04:22 2022] GET /identity/v3/role_assignments?user.id=df414bf6d05743f5a46f149bd98eed7b&scope.system=all&role.id=77e9c604ddbf4af1ab9adf2ad12a4c46 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:22.299880 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:22.325842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ef0c2-c1ad-4647-a95d-648fa55ad41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:22.332140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef0c2-c1ad-4647-a95d-648fa55ad41a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:22.332140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef0c2-c1ad-4647-a95d-648fa55ad41a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:22.332140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ef0c2-c1ad-4647-a95d-648fa55ad41a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:22.341573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ef0c2-c1ad-4647-a95d-648fa55ad41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-cd3ef0c2-c1ad-4647-a95d-648fa55ad41a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:22.347951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:22.348941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:04:22.349774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:22.354109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 183/368] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:22.355313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ef0c2-c1ad-4647-a95d-648fa55ad41a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:22.410926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:22.440621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f300f-4276-4bb9-a4d7-3c161be97b75 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:22.469606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:22.475306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ef0c2-c1ad-4647-a95d-648fa55ad41a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:22.483104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cbfe6-6196-40a0-82b2-bee7c0a393be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:22.483900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbfe6-6196-40a0-82b2-bee7c0a393be None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:22.484176 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbfe6-6196-40a0-82b2-bee7c0a393be None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:22.484507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbfe6-6196-40a0-82b2-bee7c0a393be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:22.505154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cbfe6-6196-40a0-82b2-bee7c0a393be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-ec6cbfe6-6196-40a0-82b2-bee7c0a393be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:22.512423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:22.514604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 186/369] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:22.515398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cbfe6-6196-40a0-82b2-bee7c0a393be None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:22.528837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:22.529629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:22.529983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:22.530335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:22.531292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] RBAC: Adding query filter params (group.id=fda96d73eab44b46bcce19b6355b8edf, role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:22.532253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:22.533909 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:22.541212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 184/370] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:22 2022] GET /identity/v3/role_assignments?group.id=fda96d73eab44b46bcce19b6355b8edf&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:22.542219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:22.695507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cbfe6-6196-40a0-82b2-bee7c0a393be None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:22.708953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403be88-cc89-4e1b-9135-4593840883fb None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:22.725045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:22.779920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:22.780643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:22.781005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:22.781328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:22.782167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:22.782498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:22.784161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:22.790707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:22.791439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:22.791727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:22.792036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:22.792918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:22.793544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:22.795209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:22.812449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 187/371] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:22.818122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 185/372] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:22.824746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:22.827677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:22.922552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:23.056333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817b968-3ea7-4ea3-b13d-6f4a8c3a7a28 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:23.070832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ead86-b97d-4412-a485-5038a40aa42d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:23.109672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621ef7-bb81-491e-b709-99005669c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:23.110316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621ef7-bb81-491e-b709-99005669c67a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:23.110603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621ef7-bb81-491e-b709-99005669c67a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:23.110870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621ef7-bb81-491e-b709-99005669c67a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:23.147908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d67f11-9274-4211-8580-f5d6e06a7604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:23.149178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d67f11-9274-4211-8580-f5d6e06a7604 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:23.150599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d67f11-9274-4211-8580-f5d6e06a7604 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:23.150878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d67f11-9274-4211-8580-f5d6e06a7604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:23.252202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:23.253281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6621ef7-bb81-491e-b709-99005669c67a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:23.254844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6621ef7-bb81-491e-b709-99005669c67a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:23.313671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d67f11-9274-4211-8580-f5d6e06a7604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:23.315090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d67f11-9274-4211-8580-f5d6e06a7604 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:23.333279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:23.410709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 188/373] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:23.416226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621ef7-bb81-491e-b709-99005669c67a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:23.450676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 186/374] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:23.456649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d67f11-9274-4211-8580-f5d6e06a7604 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:23.552693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:23.619033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d67f11-9274-4211-8580-f5d6e06a7604 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:23.656094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621ef7-bb81-491e-b709-99005669c67a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:23.694506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b81049-f172-4b75-bdd1-e6db667154c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:23.695570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b81049-f172-4b75-bdd1-e6db667154c4 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:23.696063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b81049-f172-4b75-bdd1-e6db667154c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:23.696536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b81049-f172-4b75-bdd1-e6db667154c4 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:23.698826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b81049-f172-4b75-bdd1-e6db667154c4 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:23.701001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b81049-f172-4b75-bdd1-e6db667154c4 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:23.704732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 187/375] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:23 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:23.710949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b81049-f172-4b75-bdd1-e6db667154c4 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:23.750111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4354e6-cdaa-486f-8ed8-5808510ecdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:23.751431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4354e6-cdaa-486f-8ed8-5808510ecdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:23.753053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4354e6-cdaa-486f-8ed8-5808510ecdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:23.753532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4354e6-cdaa-486f-8ed8-5808510ecdf9 None admin] PATH_INFO: `/v3/projects/fec42bd454d34bf891854ee5fd76a3ae` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:23.756246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4354e6-cdaa-486f-8ed8-5808510ecdf9 None admin] RBAC: Authorizing `identity:get_project(project_id=fec42bd454d34bf891854ee5fd76a3ae)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:23.758192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4354e6-cdaa-486f-8ed8-5808510ecdf9 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:23.763558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 189/376] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:23 2022] GET /identity/v3/projects/fec42bd454d34bf891854ee5fd76a3ae => generated 344 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:23.770223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4354e6-cdaa-486f-8ed8-5808510ecdf9 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:23.802959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:23.912734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b81049-f172-4b75-bdd1-e6db667154c4 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:23.976178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e5f9d-e694-44e7-9295-9c8bf23d3e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:23.977671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e5f9d-e694-44e7-9295-9c8bf23d3e3f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:23.978193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e5f9d-e694-44e7-9295-9c8bf23d3e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:23.979153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e5f9d-e694-44e7-9295-9c8bf23d3e3f None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:23.982223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e5f9d-e694-44e7-9295-9c8bf23d3e3f None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:23.983989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e5f9d-e694-44e7-9295-9c8bf23d3e3f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:23.994339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4354e6-cdaa-486f-8ed8-5808510ecdf9 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:23.995001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 188/377] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:23 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:24.010198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e5f9d-e694-44e7-9295-9c8bf23d3e3f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:24.021269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:24.064408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d233c-71dc-4bf9-b8df-e03634974ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:24.065098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d233c-71dc-4bf9-b8df-e03634974ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.065376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d233c-71dc-4bf9-b8df-e03634974ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.065646 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d233c-71dc-4bf9-b8df-e03634974ad6 None admin] PATH_INFO: `/v3/groups/737daa4f586d404bb969d6f9a1323be5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.074788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d233c-71dc-4bf9-b8df-e03634974ad6 None admin] RBAC: Authorizing `identity:get_group(group_id=737daa4f586d404bb969d6f9a1323be5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:24.076278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d233c-71dc-4bf9-b8df-e03634974ad6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:24.078437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 190/378] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:23 2022] GET /identity/v3/groups/737daa4f586d404bb969d6f9a1323be5 => generated 229 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:24.087524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d233c-71dc-4bf9-b8df-e03634974ad6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:24.212105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e5f9d-e694-44e7-9295-9c8bf23d3e3f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:24.218171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:24.261433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d233c-71dc-4bf9-b8df-e03634974ad6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:24.278576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2d459-2b88-4734-90ea-eef43dbdf87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:24.279249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d459-2b88-4734-90ea-eef43dbdf87b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.279531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d459-2b88-4734-90ea-eef43dbdf87b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.280003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d459-2b88-4734-90ea-eef43dbdf87b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.281311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d459-2b88-4734-90ea-eef43dbdf87b None admin] RBAC: Adding query filter params (group.id=fda96d73eab44b46bcce19b6355b8edf, role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:24.281633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d459-2b88-4734-90ea-eef43dbdf87b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:24.283723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d459-2b88-4734-90ea-eef43dbdf87b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:24.294098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 189/379] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/role_assignments?group.id=fda96d73eab44b46bcce19b6355b8edf&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:24.295765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2795ee-4516-48ed-aba1-daddf49934a3 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.296057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2795ee-4516-48ed-aba1-daddf49934a3 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.296334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2795ee-4516-48ed-aba1-daddf49934a3 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.298173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 190/380] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:24.302148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86f84-264e-4675-8e14-76c520a02405 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.302148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86f84-264e-4675-8e14-76c520a02405 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.302148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d86f84-264e-4675-8e14-76c520a02405 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.302471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 191/381] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:24.305919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e0c73-116d-4472-af77-7e07bfd6b933 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.306189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e0c73-116d-4472-af77-7e07bfd6b933 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.306464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e0c73-116d-4472-af77-7e07bfd6b933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.330854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-a34e0c73-116d-4472-af77-7e07bfd6b933 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:24.331367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa80eb-6fb5-4ce0-88d5-ee0a4d928887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:24.332246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa80eb-6fb5-4ce0-88d5-ee0a4d928887 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.332519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa80eb-6fb5-4ce0-88d5-ee0a4d928887 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.332793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa80eb-6fb5-4ce0-88d5-ee0a4d928887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.333490 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a34e0c73-116d-4472-af77-7e07bfd6b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:24.333671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa80eb-6fb5-4ce0-88d5-ee0a4d928887 None admin] RBAC: Adding query filter params (group.id=737daa4f586d404bb969d6f9a1323be5, role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=fec42bd454d34bf891854ee5fd76a3ae) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:24.333932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa80eb-6fb5-4ce0-88d5-ee0a4d928887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:24.336657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa80eb-6fb5-4ce0-88d5-ee0a4d928887 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:24.348409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 191/382] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/role_assignments?group.id=737daa4f586d404bb969d6f9a1323be5&scope.project.id=fec42bd454d34bf891854ee5fd76a3ae&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:24.351695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537fbad-5b39-4392-b437-6374cdd8e004 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.352204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537fbad-5b39-4392-b437-6374cdd8e004 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.352740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537fbad-5b39-4392-b437-6374cdd8e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.387307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-8537fbad-5b39-4392-b437-6374cdd8e004 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:24.389247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8537fbad-5b39-4392-b437-6374cdd8e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:24.452486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:24.459536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 192/383] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:24.480409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 192/384] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:24.491939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e0c73-116d-4472-af77-7e07bfd6b933 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:24.521876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537fbad-5b39-4392-b437-6374cdd8e004 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:24.615945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:24.625224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e0c73-116d-4472-af77-7e07bfd6b933 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:24.660005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537fbad-5b39-4392-b437-6374cdd8e004 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:24.671977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c49a1b-8a06-40b7-808a-cd7360ac6b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:24.672919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c49a1b-8a06-40b7-808a-cd7360ac6b14 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.673109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c49a1b-8a06-40b7-808a-cd7360ac6b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.673436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c49a1b-8a06-40b7-808a-cd7360ac6b14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.686688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c49a1b-8a06-40b7-808a-cd7360ac6b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-79c49a1b-8a06-40b7-808a-cd7360ac6b14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:24.692359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:24.693611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:24.694428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 193/385] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:24.700877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c49a1b-8a06-40b7-808a-cd7360ac6b14 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:24.709697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0265b-07d5-4b1b-a911-3d36a349b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:24.711421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0265b-07d5-4b1b-a911-3d36a349b253 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.711996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0265b-07d5-4b1b-a911-3d36a349b253 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.712605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0265b-07d5-4b1b-a911-3d36a349b253 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.729421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0265b-07d5-4b1b-a911-3d36a349b253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-6ef0265b-07d5-4b1b-a911-3d36a349b253 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:24.736363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:24.737736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:24.738608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:24.741523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 193/386] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:24.750295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0265b-07d5-4b1b-a911-3d36a349b253 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:24.786776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:24.838879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c49a1b-8a06-40b7-808a-cd7360ac6b14 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:24.881733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:24.882466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.882779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.883073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.883928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:24.884231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:24.885209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0265b-07d5-4b1b-a911-3d36a349b253 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:24.885653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:24.895834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 194/387] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:24.902307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:24.923556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:24.934276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:24.935357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.935849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.936353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.937651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:24.938345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:24.940125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:24.953984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 194/388] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:24.960439 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:25.030536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d78e-593a-4818-bf64-2c2e7988b36a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:25.058974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:25.074483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32959580-5d5d-4232-ac23-d0c9e4b2bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:25.075147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32959580-5d5d-4232-ac23-d0c9e4b2bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:25.075421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32959580-5d5d-4232-ac23-d0c9e4b2bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:25.075694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32959580-5d5d-4232-ac23-d0c9e4b2bab4 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:25.076978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32959580-5d5d-4232-ac23-d0c9e4b2bab4 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:25.079011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32959580-5d5d-4232-ac23-d0c9e4b2bab4 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:25.080432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 195/389] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:25.086767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32959580-5d5d-4232-ac23-d0c9e4b2bab4 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:25.095045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccdab1-e0b7-4334-97d1-55c6c512d69e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:25.163901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4ba3-c630-4910-88e3-f9a5e4fe2117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:25.164561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4ba3-c630-4910-88e3-f9a5e4fe2117 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:25.164836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4ba3-c630-4910-88e3-f9a5e4fe2117 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:25.165189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4ba3-c630-4910-88e3-f9a5e4fe2117 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:25.167394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c4ba3-c630-4910-88e3-f9a5e4fe2117 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:25.169439 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c4ba3-c630-4910-88e3-f9a5e4fe2117 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:25.171429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 195/390] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:25.179600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4ba3-c630-4910-88e3-f9a5e4fe2117 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:25.269622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32959580-5d5d-4232-ac23-d0c9e4b2bab4 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:25.297964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:25.353056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4ba3-c630-4910-88e3-f9a5e4fe2117 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:25.377936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25ee6-d3e7-4849-ac4b-58b8e13c8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:25.378665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25ee6-d3e7-4849-ac4b-58b8e13c8b1a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:25.378966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25ee6-d3e7-4849-ac4b-58b8e13c8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:25.379249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25ee6-d3e7-4849-ac4b-58b8e13c8b1a None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:25.380557 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d25ee6-d3e7-4849-ac4b-58b8e13c8b1a None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:25.382309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d25ee6-d3e7-4849-ac4b-58b8e13c8b1a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:25.385867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 196/391] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:25 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:25.391278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25ee6-d3e7-4849-ac4b-58b8e13c8b1a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:25.408239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84ee38-11ea-4a0b-a1e1-5ad5e91fbf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:25.409504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84ee38-11ea-4a0b-a1e1-5ad5e91fbf5c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:25.410057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84ee38-11ea-4a0b-a1e1-5ad5e91fbf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:25.411430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84ee38-11ea-4a0b-a1e1-5ad5e91fbf5c None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:25.413232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84ee38-11ea-4a0b-a1e1-5ad5e91fbf5c None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:25.416118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84ee38-11ea-4a0b-a1e1-5ad5e91fbf5c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:25.419603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 196/392] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:25 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:25.426513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84ee38-11ea-4a0b-a1e1-5ad5e91fbf5c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:25.513833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:25.594883 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84ee38-11ea-4a0b-a1e1-5ad5e91fbf5c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:25.631435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:25.635200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25ee6-d3e7-4849-ac4b-58b8e13c8b1a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:25.641582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6fe4e-b00e-46a9-acf2-f680a42633c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:25.642470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6fe4e-b00e-46a9-acf2-f680a42633c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:25.642877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6fe4e-b00e-46a9-acf2-f680a42633c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:25.650396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6fe4e-b00e-46a9-acf2-f680a42633c8 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7/groups/fda96d73eab44b46bcce19b6355b8edf/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:25.650396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6fe4e-b00e-46a9-acf2-f680a42633c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=81c7e412e96f4fadaa334b907d4734e7, group_id=fda96d73eab44b46bcce19b6355b8edf, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:25.650396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6fe4e-b00e-46a9-acf2-f680a42633c8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:25.689911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8776a0-114f-4ef4-a86b-3d2a2d9d131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:25.690605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8776a0-114f-4ef4-a86b-3d2a2d9d131c None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:25.690889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8776a0-114f-4ef4-a86b-3d2a2d9d131c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:25.691168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8776a0-114f-4ef4-a86b-3d2a2d9d131c None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7/groups/fda96d73eab44b46bcce19b6355b8edf/roles/59b4966b7b764eb5bc24547e4faef790` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:25.693639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8776a0-114f-4ef4-a86b-3d2a2d9d131c None admin] RBAC: Authorizing `identity:create_grant(project_id=81c7e412e96f4fadaa334b907d4734e7, group_id=fda96d73eab44b46bcce19b6355b8edf, role_id=59b4966b7b764eb5bc24547e4faef790)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:25.696295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8776a0-114f-4ef4-a86b-3d2a2d9d131c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:25.772075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 197/393] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Aug 4 21:04:25 2022] PUT /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7/groups/fda96d73eab44b46bcce19b6355b8edf/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:25.774152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44568-428b-4b8c-9d26-d1c0516ec474 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:25.774438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44568-428b-4b8c-9d26-d1c0516ec474 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:25.774706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44568-428b-4b8c-9d26-d1c0516ec474 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:25.777501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 198/394] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:25.783973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47620-77d7-4567-87c0-7538a94cec39 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:25.784308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47620-77d7-4567-87c0-7538a94cec39 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:25.784507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47620-77d7-4567-87c0-7538a94cec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:25.809862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0fc47620-77d7-4567-87c0-7538a94cec39 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:25.811268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0fc47620-77d7-4567-87c0-7538a94cec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:25.884288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 197/395] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Aug 4 21:04:25 2022] PUT /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7/groups/fda96d73eab44b46bcce19b6355b8edf/roles/59b4966b7b764eb5bc24547e4faef790 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:25.920277 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 199/396] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:25.966475 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8776a0-114f-4ef4-a86b-3d2a2d9d131c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:26.106922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8776a0-114f-4ef4-a86b-3d2a2d9d131c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:26.128800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:26.151211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1c6c9-512c-4dfa-aa75-567d14d34a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:26.151871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1c6c9-512c-4dfa-aa75-567d14d34a3e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.152161 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1c6c9-512c-4dfa-aa75-567d14d34a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.152730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1c6c9-512c-4dfa-aa75-567d14d34a3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.169761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1c6c9-512c-4dfa-aa75-567d14d34a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-f1f1c6c9-512c-4dfa-aa75-567d14d34a3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:26.175480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:26.176580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:26.177553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:26.178763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 198/397] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:26.183818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47620-77d7-4567-87c0-7538a94cec39 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:26.359235 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47620-77d7-4567-87c0-7538a94cec39 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:26.399481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:26.424365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:26.424937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.425272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.425553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.426266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:26.426570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:26.427935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:26.441108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 200/398] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:26.451299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1c6c9-512c-4dfa-aa75-567d14d34a3e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:26.633916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1c6c9-512c-4dfa-aa75-567d14d34a3e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:26.683121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d583d75-044b-452b-bb60-e52297ce2e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:26.683794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d583d75-044b-452b-bb60-e52297ce2e72 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.684079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d583d75-044b-452b-bb60-e52297ce2e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.684363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d583d75-044b-452b-bb60-e52297ce2e72 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.685740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d583d75-044b-452b-bb60-e52297ce2e72 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:26.687293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d583d75-044b-452b-bb60-e52297ce2e72 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:26.689450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 199/399] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:26 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:26.698025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:26.864476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39645e-513c-4014-b552-2f74a00e200f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:26.921048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9e29b-e272-4b0c-b6df-24a17cf6422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:26.921716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e29b-e272-4b0c-b6df-24a17cf6422d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.921997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e29b-e272-4b0c-b6df-24a17cf6422d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.922269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e29b-e272-4b0c-b6df-24a17cf6422d None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.924041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9e29b-e272-4b0c-b6df-24a17cf6422d None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:26.925987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9e29b-e272-4b0c-b6df-24a17cf6422d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:26.929084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 201/400] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:26 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:26.935558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d583d75-044b-452b-bb60-e52297ce2e72 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:26.998220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:27.076423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d583d75-044b-452b-bb60-e52297ce2e72 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:27.117535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b6aa4-64f6-4dc3-b0c0-0a38122fe7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:27.118557 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b6aa4-64f6-4dc3-b0c0-0a38122fe7e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.118911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b6aa4-64f6-4dc3-b0c0-0a38122fe7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.119231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b6aa4-64f6-4dc3-b0c0-0a38122fe7e8 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/groups/fda96d73eab44b46bcce19b6355b8edf/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.121421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b6aa4-64f6-4dc3-b0c0-0a38122fe7e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=51fa6c38b60446aa9a9d93a3a3980e38, group_id=fda96d73eab44b46bcce19b6355b8edf, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:27.122960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b6aa4-64f6-4dc3-b0c0-0a38122fe7e8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:27.239836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 200/401] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Aug 4 21:04:26 2022] PUT /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/groups/fda96d73eab44b46bcce19b6355b8edf/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:27.466836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce728d-e5d8-4aa1-80db-1157b28c6b5c None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.467559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce728d-e5d8-4aa1-80db-1157b28c6b5c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.467559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce728d-e5d8-4aa1-80db-1157b28c6b5c None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.469060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 202/402] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:27.475162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000c79-80da-4ccc-9eba-777085c7f516 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.475732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000c79-80da-4ccc-9eba-777085c7f516 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.475732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000c79-80da-4ccc-9eba-777085c7f516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.498137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-bd000c79-80da-4ccc-9eba-777085c7f516 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:27.499850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bd000c79-80da-4ccc-9eba-777085c7f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:27.595776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 201/403] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:27.637835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0f84a-7e56-4d96-ac0d-02812d75e6d6 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.638120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0f84a-7e56-4d96-ac0d-02812d75e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.638419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0f84a-7e56-4d96-ac0d-02812d75e6d6 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.639736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000c79-80da-4ccc-9eba-777085c7f516 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:27.639848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 203/404] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:27.645013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a104c-c041-4680-89d6-7a830a41aaba None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.645595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a104c-c041-4680-89d6-7a830a41aaba None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.646128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a104c-c041-4680-89d6-7a830a41aaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.677314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:27.690028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c34a104c-c041-4680-89d6-7a830a41aaba None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:27.691566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c34a104c-c041-4680-89d6-7a830a41aaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:27.785116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000c79-80da-4ccc-9eba-777085c7f516 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:27.834098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00053a26-055d-446f-a8b6-b3bca2dd2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:27.834949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00053a26-055d-446f-a8b6-b3bca2dd2958 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.835228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00053a26-055d-446f-a8b6-b3bca2dd2958 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.835504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00053a26-055d-446f-a8b6-b3bca2dd2958 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.860758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:27.871204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00053a26-055d-446f-a8b6-b3bca2dd2958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-00053a26-055d-446f-a8b6-b3bca2dd2958 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:27.878734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:27.879856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:27.880869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:27.890451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 202/405] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:27.891394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00053a26-055d-446f-a8b6-b3bca2dd2958 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:27.920438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 204/406] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:27.967864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a104c-c041-4680-89d6-7a830a41aaba None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.139250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:28.150573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00053a26-055d-446f-a8b6-b3bca2dd2958 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.243035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.243759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.244049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.244322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.245166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:28.245685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.247357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.278695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 203/407] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:28.286793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.492989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e9ce-29c2-41bf-8041-b731f52285e3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.494361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a104c-c041-4680-89d6-7a830a41aaba None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.559999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f55ba-5618-49f2-8633-c95e0a5ac14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.561087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f55ba-5618-49f2-8633-c95e0a5ac14b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.561607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f55ba-5618-49f2-8633-c95e0a5ac14b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.562145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f55ba-5618-49f2-8633-c95e0a5ac14b None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.563879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f55ba-5618-49f2-8633-c95e0a5ac14b None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.566135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f55ba-5618-49f2-8633-c95e0a5ac14b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.568433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 204/408] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:28.573584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f55ba-5618-49f2-8633-c95e0a5ac14b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.609283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:28.647328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d5b09-3fba-4348-b4d8-e203d0e15490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.648393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5b09-3fba-4348-b4d8-e203d0e15490 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.648393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5b09-3fba-4348-b4d8-e203d0e15490 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.649209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5b09-3fba-4348-b4d8-e203d0e15490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.685867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d5b09-3fba-4348-b4d8-e203d0e15490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-5d9d5b09-3fba-4348-b4d8-e203d0e15490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:28.691012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:28.692173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:28.693668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 205/409] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 725 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:28.694434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7fd66-126d-4051-9c54-34ff9d9b52c0 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.694434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7fd66-126d-4051-9c54-34ff9d9b52c0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.694549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7fd66-126d-4051-9c54-34ff9d9b52c0 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.700753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 206/410] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:28.701645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7fd66-126d-4051-9c54-34ff9d9b52c0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.707432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f55ba-5618-49f2-8633-c95e0a5ac14b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.755220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33cde0-7587-4c5c-8f24-a7109620aaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.755888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cde0-7587-4c5c-8f24-a7109620aaff None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.756353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:28.756695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cde0-7587-4c5c-8f24-a7109620aaff None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.757035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cde0-7587-4c5c-8f24-a7109620aaff None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.758613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33cde0-7587-4c5c-8f24-a7109620aaff None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.760672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33cde0-7587-4c5c-8f24-a7109620aaff None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.762789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 205/411] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:28.764176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c186-5a40-43da-80eb-8f153375041c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.764493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c186-5a40-43da-80eb-8f153375041c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.764771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c186-5a40-43da-80eb-8f153375041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.785946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-7c63c186-5a40-43da-80eb-8f153375041c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:28.787468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7c63c186-5a40-43da-80eb-8f153375041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:28.834257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7fd66-126d-4051-9c54-34ff9d9b52c0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.872077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 206/412] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:28.873679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60310c0a-c5a6-46fa-b5bc-446685f1f06b None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.873976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60310c0a-c5a6-46fa-b5bc-446685f1f06b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.874339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60310c0a-c5a6-46fa-b5bc-446685f1f06b None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.877048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 207/413] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:28.877048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60310c0a-c5a6-46fa-b5bc-446685f1f06b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.879215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11735-766a-4d68-b93e-d752a1f5aec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.880363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11735-766a-4d68-b93e-d752a1f5aec9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.880840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11735-766a-4d68-b93e-d752a1f5aec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.881337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11735-766a-4d68-b93e-d752a1f5aec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.882525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11735-766a-4d68-b93e-d752a1f5aec9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:28.882887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11735-766a-4d68-b93e-d752a1f5aec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.884469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11735-766a-4d68-b93e-d752a1f5aec9 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.896265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 207/414] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:28.899356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f2c4-7455-4e88-9628-b9bf3d400c38 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.899356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f2c4-7455-4e88-9628-b9bf3d400c38 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.899652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384f2c4-7455-4e88-9628-b9bf3d400c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.920260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:28.920688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6384f2c4-7455-4e88-9628-b9bf3d400c38 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:28.922160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6384f2c4-7455-4e88-9628-b9bf3d400c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:29.001105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 208/415] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:29.001105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384f2c4-7455-4e88-9628-b9bf3d400c38 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.014559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60310c0a-c5a6-46fa-b5bc-446685f1f06b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.047053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:29.058096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a08d7-10b9-4e17-9b7c-ac0eb4d179ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.059041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a08d7-10b9-4e17-9b7c-ac0eb4d179ef None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.059149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a08d7-10b9-4e17-9b7c-ac0eb4d179ef None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.059374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a08d7-10b9-4e17-9b7c-ac0eb4d179ef None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/groups/fda96d73eab44b46bcce19b6355b8edf/roles/59b4966b7b764eb5bc24547e4faef790` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.061637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a08d7-10b9-4e17-9b7c-ac0eb4d179ef None admin] RBAC: Authorizing `identity:create_grant(project_id=51fa6c38b60446aa9a9d93a3a3980e38, group_id=fda96d73eab44b46bcce19b6355b8edf, role_id=59b4966b7b764eb5bc24547e4faef790)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.063222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a08d7-10b9-4e17-9b7c-ac0eb4d179ef None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.124402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384f2c4-7455-4e88-9628-b9bf3d400c38 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.162960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45755750-3abf-4f01-a9c8-de1a309be85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.164446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45755750-3abf-4f01-a9c8-de1a309be85a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.164641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45755750-3abf-4f01-a9c8-de1a309be85a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.164958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45755750-3abf-4f01-a9c8-de1a309be85a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.176193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45755750-3abf-4f01-a9c8-de1a309be85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-45755750-3abf-4f01-a9c8-de1a309be85a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:29.181659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:29.182695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:29.183512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 209/416] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:29.184160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45755750-3abf-4f01-a9c8-de1a309be85a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.283460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 208/417] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Aug 4 21:04:28 2022] PUT /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38/groups/fda96d73eab44b46bcce19b6355b8edf/roles/59b4966b7b764eb5bc24547e4faef790 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:29.283460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a08d7-10b9-4e17-9b7c-ac0eb4d179ef None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.299382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:29.310800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45755750-3abf-4f01-a9c8-de1a309be85a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.357562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4a33-23ae-4d9a-8bdb-e2e62cd8ba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.358441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4a33-23ae-4d9a-8bdb-e2e62cd8ba24 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.358743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4a33-23ae-4d9a-8bdb-e2e62cd8ba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.359112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4a33-23ae-4d9a-8bdb-e2e62cd8ba24 None admin] PATH_INFO: `/v3/groups/737daa4f586d404bb969d6f9a1323be5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.360705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4a33-23ae-4d9a-8bdb-e2e62cd8ba24 None admin] RBAC: Authorizing `identity:get_group(group_id=737daa4f586d404bb969d6f9a1323be5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.362489 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4a33-23ae-4d9a-8bdb-e2e62cd8ba24 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.369679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 210/418] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/groups/737daa4f586d404bb969d6f9a1323be5 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:29.369679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4a33-23ae-4d9a-8bdb-e2e62cd8ba24 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.395902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:29.417368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a08d7-10b9-4e17-9b7c-ac0eb4d179ef None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.460276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b3b7-b7d9-4323-8ec8-2fe5ee9a52ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.461747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b3b7-b7d9-4323-8ec8-2fe5ee9a52ae None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.462344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b3b7-b7d9-4323-8ec8-2fe5ee9a52ae None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.462931 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b3b7-b7d9-4323-8ec8-2fe5ee9a52ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.479708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b3b7-b7d9-4323-8ec8-2fe5ee9a52ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-8457b3b7-b7d9-4323-8ec8-2fe5ee9a52ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:29.486594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:29.487743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:29.488664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:29.489809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 209/419] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:29.490539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b3b7-b7d9-4323-8ec8-2fe5ee9a52ae None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.506390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4a33-23ae-4d9a-8bdb-e2e62cd8ba24 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.557253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.557980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.558479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.559014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.560408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:29.560994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.562709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.573767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 211/420] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:29.574772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.611850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:29.637352 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b3b7-b7d9-4323-8ec8-2fe5ee9a52ae None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.697831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5e9ba-8885-438d-b12d-cb89e57c539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.699946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e9ba-8885-438d-b12d-cb89e57c539a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.700662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e9ba-8885-438d-b12d-cb89e57c539a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.701637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e9ba-8885-438d-b12d-cb89e57c539a None admin] PATH_INFO: `/v3/projects/fec42bd454d34bf891854ee5fd76a3ae` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.704124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5e9ba-8885-438d-b12d-cb89e57c539a None admin] RBAC: Authorizing `identity:get_project(project_id=fec42bd454d34bf891854ee5fd76a3ae)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.707527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5e9ba-8885-438d-b12d-cb89e57c539a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.711452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 210/421] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/projects/fec42bd454d34bf891854ee5fd76a3ae => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:29.713415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5e9ba-8885-438d-b12d-cb89e57c539a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.733830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5037d-154e-4a27-a7a5-4603a7df0b8c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.741561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:29.800185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.801196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.801669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.802136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.803503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:29.804091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.807395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.828916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 212/422] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:29.828916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.906066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5e9ba-8885-438d-b12d-cb89e57c539a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.951822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:29.953068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b942c10-59da-4fe6-acda-6227564d6b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.954235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942c10-59da-4fe6-acda-6227564d6b81 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.954740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942c10-59da-4fe6-acda-6227564d6b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.955427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942c10-59da-4fe6-acda-6227564d6b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.980143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61695-019a-4322-80c7-887df80e56bd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.026724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4857f7-6f8e-4235-9323-01d1d2bbfa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.027531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4857f7-6f8e-4235-9323-01d1d2bbfa3a None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.027712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4857f7-6f8e-4235-9323-01d1d2bbfa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.027931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4857f7-6f8e-4235-9323-01d1d2bbfa3a None admin] PATH_INFO: `/v3/projects/fec42bd454d34bf891854ee5fd76a3ae/groups/737daa4f586d404bb969d6f9a1323be5/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.029979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4857f7-6f8e-4235-9323-01d1d2bbfa3a None admin] RBAC: Authorizing `identity:create_grant(project_id=fec42bd454d34bf891854ee5fd76a3ae, group_id=737daa4f586d404bb969d6f9a1323be5, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.031416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4857f7-6f8e-4235-9323-01d1d2bbfa3a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.044062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942c10-59da-4fe6-acda-6227564d6b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.045726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942c10-59da-4fe6-acda-6227564d6b81 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.061871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:30.121546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 213/423] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Aug 4 21:04:29 2022] PUT /identity/v3/projects/fec42bd454d34bf891854ee5fd76a3ae/groups/737daa4f586d404bb969d6f9a1323be5/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:30.122954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4857f7-6f8e-4235-9323-01d1d2bbfa3a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.174839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 211/424] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:30.180857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b942c10-59da-4fe6-acda-6227564d6b81 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.341354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4857f7-6f8e-4235-9323-01d1d2bbfa3a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.381723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b942c10-59da-4fe6-acda-6227564d6b81 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.394040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42da469-b5f2-4666-af8c-ff55ec582398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.395612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da469-b5f2-4666-af8c-ff55ec582398 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.396355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da469-b5f2-4666-af8c-ff55ec582398 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.397411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:30.397896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42da469-b5f2-4666-af8c-ff55ec582398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.424411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac98799-5151-4664-af73-2d67fb85ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.425101 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac98799-5151-4664-af73-2d67fb85ab10 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.425439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac98799-5151-4664-af73-2d67fb85ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.425722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac98799-5151-4664-af73-2d67fb85ab10 None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.427157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:30.427769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac98799-5151-4664-af73-2d67fb85ab10 None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.429726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac98799-5151-4664-af73-2d67fb85ab10 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.431422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 212/425] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:30.439617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8e72-7e06-4e9a-bb17-e2c4d4815db9 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.439617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8e72-7e06-4e9a-bb17-e2c4d4815db9 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.439617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8e72-7e06-4e9a-bb17-e2c4d4815db9 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.439617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 213/426] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:30.440790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2102cd-18ae-422e-b094-26f49798387a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.441111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2102cd-18ae-422e-b094-26f49798387a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.441389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2102cd-18ae-422e-b094-26f49798387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.468734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-0e2102cd-18ae-422e-b094-26f49798387a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:30.470077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0e2102cd-18ae-422e-b094-26f49798387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:30.517916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42da469-b5f2-4666-af8c-ff55ec582398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.521261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42da469-b5f2-4666-af8c-ff55ec582398 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.569007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 214/427] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:30.570058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2102cd-18ae-422e-b094-26f49798387a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.657864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 214/428] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:30.659016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42da469-b5f2-4666-af8c-ff55ec582398 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.700760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2102cd-18ae-422e-b094-26f49798387a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.713957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:30.716120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:30.750885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d136a4-ba05-4715-9747-c246a9abbaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.752130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d136a4-ba05-4715-9747-c246a9abbaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.752945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d136a4-ba05-4715-9747-c246a9abbaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.754527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d136a4-ba05-4715-9747-c246a9abbaa5 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.756135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d136a4-ba05-4715-9747-c246a9abbaa5 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.758840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d136a4-ba05-4715-9747-c246a9abbaa5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.768213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 215/429] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:30.769165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d136a4-ba05-4715-9747-c246a9abbaa5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.794785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42da469-b5f2-4666-af8c-ff55ec582398 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.834152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9c75-cd85-48b6-9897-6bb07a3ffd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.834802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9c75-cd85-48b6-9897-6bb07a3ffd44 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.835092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9c75-cd85-48b6-9897-6bb07a3ffd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.835740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9c75-cd85-48b6-9897-6bb07a3ffd44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.846938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d9c75-cd85-48b6-9897-6bb07a3ffd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-fe9d9c75-cd85-48b6-9897-6bb07a3ffd44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:30.853224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:30.854170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:30.854979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 215/430] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:30.860046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9c75-cd85-48b6-9897-6bb07a3ffd44 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.920720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d136a4-ba05-4715-9747-c246a9abbaa5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.964509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932814ef-7e77-4e2b-92d9-d562a3e3215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.965185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932814ef-7e77-4e2b-92d9-d562a3e3215f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.965516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932814ef-7e77-4e2b-92d9-d562a3e3215f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.965797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932814ef-7e77-4e2b-92d9-d562a3e3215f None admin] PATH_INFO: `/v3/projects/81c7e412e96f4fadaa334b907d4734e7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.967255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932814ef-7e77-4e2b-92d9-d562a3e3215f None admin] RBAC: Authorizing `identity:get_project(project_id=81c7e412e96f4fadaa334b907d4734e7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.968991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932814ef-7e77-4e2b-92d9-d562a3e3215f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.971774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 216/431] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/projects/81c7e412e96f4fadaa334b907d4734e7 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:30.972645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932814ef-7e77-4e2b-92d9-d562a3e3215f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.997610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9c75-cd85-48b6-9897-6bb07a3ffd44 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.999536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:31.034145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:31.035804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:31.036797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.037295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.038266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.040339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] RBAC: Adding query filter params (group.id=fda96d73eab44b46bcce19b6355b8edf, role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=81c7e412e96f4fadaa334b907d4734e7) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:31.041606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:31.045297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:31.061393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 216/432] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/role_assignments?group.id=fda96d73eab44b46bcce19b6355b8edf&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:31.061393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:31.215333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932814ef-7e77-4e2b-92d9-d562a3e3215f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:31.245463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd87b1-d7be-4168-8ddb-0e4c239c8676 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:31.308778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49ad41-c645-42ed-87b4-6ec095704507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:31.309918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ad41-c645-42ed-87b4-6ec095704507 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.310084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:31.310572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.310758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ad41-c645-42ed-87b4-6ec095704507 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.310914 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.311117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.311496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ad41-c645-42ed-87b4-6ec095704507 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.311842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] RBAC: Adding query filter params (name=member) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:31.312145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:31.313569 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:31.313907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49ad41-c645-42ed-87b4-6ec095704507 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:31.316822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49ad41-c645-42ed-87b4-6ec095704507 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:31.320837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 217/433] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:31 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:31.338036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49ad41-c645-42ed-87b4-6ec095704507 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:31.338233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 217/434] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:31.339429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:31.398669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:31.497655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49ad41-c645-42ed-87b4-6ec095704507 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:31.561153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:31.561814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fca59-62cf-402b-81d7-b23be3c23579 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:31.562642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.563278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.564094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.565211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] RBAC: Adding query filter params (group.id=fda96d73eab44b46bcce19b6355b8edf, role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=81c7e412e96f4fadaa334b907d4734e7) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:31.565703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:31.567380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:31.573138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:31.576466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 218/435] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:31 2022] GET /identity/v3/role_assignments?group.id=fda96d73eab44b46bcce19b6355b8edf&scope.project.id=81c7e412e96f4fadaa334b907d4734e7&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 611 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:31.614499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc6b71-b186-40de-b0bb-23fc0caa12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:31.615577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc6b71-b186-40de-b0bb-23fc0caa12fa None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.616068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc6b71-b186-40de-b0bb-23fc0caa12fa None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.616559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc6b71-b186-40de-b0bb-23fc0caa12fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.757976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc6b71-b186-40de-b0bb-23fc0caa12fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:31.760770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc6b71-b186-40de-b0bb-23fc0caa12fa None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:31.882271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 218/436] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:31.894800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:31.904302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0357da2-d423-429c-81ba-b15e1d8619f2 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.905086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0357da2-d423-429c-81ba-b15e1d8619f2 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.905635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0357da2-d423-429c-81ba-b15e1d8619f2 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.907615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 219/437] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:31.915045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c1a4-dceb-4224-a330-97e5bbd0304d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.915483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c1a4-dceb-4224-a330-97e5bbd0304d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.916099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518c1a4-dceb-4224-a330-97e5bbd0304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.946491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c518c1a4-dceb-4224-a330-97e5bbd0304d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:31.948100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c518c1a4-dceb-4224-a330-97e5bbd0304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:31.950584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:32.056921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 220/438] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:32.079995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518c1a4-dceb-4224-a330-97e5bbd0304d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:32.084341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:32.088646 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd32f7-3ae8-440e-bd74-c762bfa4d598 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:32.152141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbc414-38a2-47f3-b2fc-071d5eacf7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:32.152795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc414-38a2-47f3-b2fc-071d5eacf7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.153980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc414-38a2-47f3-b2fc-071d5eacf7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.154255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc414-38a2-47f3-b2fc-071d5eacf7a5 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.155681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbc414-38a2-47f3-b2fc-071d5eacf7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:32.157476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbc414-38a2-47f3-b2fc-071d5eacf7a5 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:32.159863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 219/439] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:31 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:32.166882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbc414-38a2-47f3-b2fc-071d5eacf7a5 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:32.241603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518c1a4-dceb-4224-a330-97e5bbd0304d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:32.307249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd9a57-3177-4829-961a-131cdfb13c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:32.307854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd9a57-3177-4829-961a-131cdfb13c0e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.308137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd9a57-3177-4829-961a-131cdfb13c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.308411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd9a57-3177-4829-961a-131cdfb13c0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.324737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:32.328534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbc414-38a2-47f3-b2fc-071d5eacf7a5 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:32.330934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd9a57-3177-4829-961a-131cdfb13c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-c2dd9a57-3177-4829-961a-131cdfb13c0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:32.339166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:32.340262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:32.341346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 221/440] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:32.352009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd9a57-3177-4829-961a-131cdfb13c0e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:32.377889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e0d2-4f44-4a05-bf49-c1afa719b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:32.378859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e0d2-4f44-4a05-bf49-c1afa719b7db None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.379161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e0d2-4f44-4a05-bf49-c1afa719b7db None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.379736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e0d2-4f44-4a05-bf49-c1afa719b7db None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.381546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7e0d2-4f44-4a05-bf49-c1afa719b7db None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:32.384159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7e0d2-4f44-4a05-bf49-c1afa719b7db None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:32.388982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 220/441] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:32 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:32.392743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e0d2-4f44-4a05-bf49-c1afa719b7db None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:32.442052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:32.499674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd9a57-3177-4829-961a-131cdfb13c0e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:32.533310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e0d2-4f44-4a05-bf49-c1afa719b7db None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:32.536421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a5c98-c0de-4bdc-b21f-84b21db2f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:32.537103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5c98-c0de-4bdc-b21f-84b21db2f01b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.537378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5c98-c0de-4bdc-b21f-84b21db2f01b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.537649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5c98-c0de-4bdc-b21f-84b21db2f01b None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.538370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a5c98-c0de-4bdc-b21f-84b21db2f01b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:32.539250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a5c98-c0de-4bdc-b21f-84b21db2f01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:32.541072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a5c98-c0de-4bdc-b21f-84b21db2f01b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:32.551778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 222/442] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:32.553173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690d1a-0ddf-4f87-a5f9-4e58169a1876 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.553449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690d1a-0ddf-4f87-a5f9-4e58169a1876 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.553725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690d1a-0ddf-4f87-a5f9-4e58169a1876 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.555592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 223/443] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:32.558748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d690d1a-0ddf-4f87-a5f9-4e58169a1876 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:32.582742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644df0aa-d332-4271-af51-559c24135bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:32.583364 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df0aa-d332-4271-af51-559c24135bae None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.583630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df0aa-d332-4271-af51-559c24135bae None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.583899 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df0aa-d332-4271-af51-559c24135bae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.584698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644df0aa-d332-4271-af51-559c24135bae None admin] RBAC: Adding query filter params (group.id=fda96d73eab44b46bcce19b6355b8edf, role.id=59c9db9bdfff4dddb561f03e052100d2, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:32.585038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644df0aa-d332-4271-af51-559c24135bae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:32.586721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644df0aa-d332-4271-af51-559c24135bae None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:32.592788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 221/444] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:32 2022] GET /identity/v3/role_assignments?group.id=fda96d73eab44b46bcce19b6355b8edf&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=59c9db9bdfff4dddb561f03e052100d2 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:32.594352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cb77-df20-49a6-8d1c-b7abaceb798f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.594352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cb77-df20-49a6-8d1c-b7abaceb798f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.594635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57cb77-df20-49a6-8d1c-b7abaceb798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.628383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-bc57cb77-df20-49a6-8d1c-b7abaceb798f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:32.629680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bc57cb77-df20-49a6-8d1c-b7abaceb798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:32.651653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:32.727556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d690d1a-0ddf-4f87-a5f9-4e58169a1876 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:32.734538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 222/445] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:32.757710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57cb77-df20-49a6-8d1c-b7abaceb798f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:32.801318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:32.802220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c921-0159-40b2-99e0-b9e13058caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:32.803312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c921-0159-40b2-99e0-b9e13058caab None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.803312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c921-0159-40b2-99e0-b9e13058caab None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.803711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c921-0159-40b2-99e0-b9e13058caab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.901491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57cb77-df20-49a6-8d1c-b7abaceb798f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:32.911545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c921-0159-40b2-99e0-b9e13058caab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:32.914572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c921-0159-40b2-99e0-b9e13058caab None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:32.954354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e493-ed31-43a9-bde9-066134e4516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:32.955064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e493-ed31-43a9-bde9-066134e4516c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.955363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e493-ed31-43a9-bde9-066134e4516c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.955662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e493-ed31-43a9-bde9-066134e4516c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.972029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e493-ed31-43a9-bde9-066134e4516c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-1eb6e493-ed31-43a9-bde9-066134e4516c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:32.978320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:32.979471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:32.980254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 223/446] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:32.986363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e493-ed31-43a9-bde9-066134e4516c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:32.986528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.054054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 224/447] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:33.057436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c921-0159-40b2-99e0-b9e13058caab None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:33.096878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.111097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e493-ed31-43a9-bde9-066134e4516c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.149342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.150645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.150981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.151282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.152089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:33.152368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.153849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:33.167194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 224/448] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:33.169809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c921-0159-40b2-99e0-b9e13058caab None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.173318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:33.207556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b1b6b-dd45-496e-8834-e581f4fdb153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.208322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1b6b-dd45-496e-8834-e581f4fdb153 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.208606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1b6b-dd45-496e-8834-e581f4fdb153 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.208878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1b6b-dd45-496e-8834-e581f4fdb153 None admin] PATH_INFO: `/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.210116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b1b6b-dd45-496e-8834-e581f4fdb153 None admin] RBAC: Authorizing `identity:get_project(project_id=51fa6c38b60446aa9a9d93a3a3980e38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.211808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b1b6b-dd45-496e-8834-e581f4fdb153 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:33.213677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 225/449] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:33 2022] GET /identity/v3/projects/51fa6c38b60446aa9a9d93a3a3980e38 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:33.219282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b1b6b-dd45-496e-8834-e581f4fdb153 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:33.254002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.297047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbdb75-1d9a-4441-a662-43152106507b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.335690 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc14b5f-89f0-4e6e-94c0-2279906f343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.336182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc14b5f-89f0-4e6e-94c0-2279906f343b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.336495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc14b5f-89f0-4e6e-94c0-2279906f343b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.336849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc14b5f-89f0-4e6e-94c0-2279906f343b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.343847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b1b6b-dd45-496e-8834-e581f4fdb153 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.358014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.381167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f1122-0f1d-4c3e-9594-8c9569db43f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.381806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1122-0f1d-4c3e-9594-8c9569db43f3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.382084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1122-0f1d-4c3e-9594-8c9569db43f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.382397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1122-0f1d-4c3e-9594-8c9569db43f3 None admin] PATH_INFO: `/v3/groups/fda96d73eab44b46bcce19b6355b8edf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.383871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f1122-0f1d-4c3e-9594-8c9569db43f3 None admin] RBAC: Authorizing `identity:get_group(group_id=fda96d73eab44b46bcce19b6355b8edf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.385350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f1122-0f1d-4c3e-9594-8c9569db43f3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:33.387167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 226/450] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:33 2022] GET /identity/v3/groups/fda96d73eab44b46bcce19b6355b8edf => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:33.393160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f1122-0f1d-4c3e-9594-8c9569db43f3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:33.417255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc14b5f-89f0-4e6e-94c0-2279906f343b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.418931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc14b5f-89f0-4e6e-94c0-2279906f343b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:33.498311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.503982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f1122-0f1d-4c3e-9594-8c9569db43f3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.530869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 225/451] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 21:04:33.536548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc14b5f-89f0-4e6e-94c0-2279906f343b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:33.540840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.542026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.542470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.543321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.544111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] RBAC: Adding query filter params (group.id=fda96d73eab44b46bcce19b6355b8edf, role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:33.544416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.545917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:33.552098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 227/452] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:33 2022] GET /identity/v3/role_assignments?group.id=fda96d73eab44b46bcce19b6355b8edf&scope.project.id=51fa6c38b60446aa9a9d93a3a3980e38&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:33.593325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.646979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc14b5f-89f0-4e6e-94c0-2279906f343b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.685862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c327a-c545-4127-80a5-8e3e57c401c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.686430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c327a-c545-4127-80a5-8e3e57c401c6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.686707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c327a-c545-4127-80a5-8e3e57c401c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.686984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c327a-c545-4127-80a5-8e3e57c401c6 None admin] PATH_INFO: `/v3/projects/fec42bd454d34bf891854ee5fd76a3ae` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.688199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c327a-c545-4127-80a5-8e3e57c401c6 None admin] RBAC: Authorizing `identity:get_project(project_id=fec42bd454d34bf891854ee5fd76a3ae)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.689701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c327a-c545-4127-80a5-8e3e57c401c6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:33.691407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 226/453] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:04:33 2022] GET /identity/v3/projects/fec42bd454d34bf891854ee5fd76a3ae => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:33.697596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:33.805983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585840f-077e-4f8f-b103-e03358ee09e2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.841994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472ce44-3c58-48de-b5c4-11baae9f33ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.842645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472ce44-3c58-48de-b5c4-11baae9f33ec None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.842928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472ce44-3c58-48de-b5c4-11baae9f33ec None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.843204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472ce44-3c58-48de-b5c4-11baae9f33ec None admin] PATH_INFO: `/v3/groups/737daa4f586d404bb969d6f9a1323be5` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.844358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472ce44-3c58-48de-b5c4-11baae9f33ec None admin] RBAC: Authorizing `identity:get_group(group_id=737daa4f586d404bb969d6f9a1323be5)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.845846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472ce44-3c58-48de-b5c4-11baae9f33ec None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:33.847576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 228/454] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Aug 4 21:04:33 2022] GET /identity/v3/groups/737daa4f586d404bb969d6f9a1323be5 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:33.854446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c327a-c545-4127-80a5-8e3e57c401c6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:33.958770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c327a-c545-4127-80a5-8e3e57c401c6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.976692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:33.994203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea0a86-9436-412e-b9c5-5ea3aed119c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.994811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0a86-9436-412e-b9c5-5ea3aed119c7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.995090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0a86-9436-412e-b9c5-5ea3aed119c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.995386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea0a86-9436-412e-b9c5-5ea3aed119c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.996175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0a86-9436-412e-b9c5-5ea3aed119c7 None admin] RBAC: Adding query filter params (group.id=737daa4f586d404bb969d6f9a1323be5, role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=fec42bd454d34bf891854ee5fd76a3ae) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:33.996484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0a86-9436-412e-b9c5-5ea3aed119c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.998009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea0a86-9436-412e-b9c5-5ea3aed119c7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:34.003916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 227/455] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Aug 4 21:04:33 2022] GET /identity/v3/role_assignments?group.id=737daa4f586d404bb969d6f9a1323be5&scope.project.id=fec42bd454d34bf891854ee5fd76a3ae&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:36.388109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c8c2-fb7b-48b2-b182-a692d9a45e6d None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:36.388634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c8c2-fb7b-48b2-b182-a692d9a45e6d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:36.388634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c8c2-fb7b-48b2-b182-a692d9a45e6d None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:36.390282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 229/456] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:36.400429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eedb38-a9d7-4b2c-b57c-5e1714783b98 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:36.400975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eedb38-a9d7-4b2c-b57c-5e1714783b98 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:36.401054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eedb38-a9d7-4b2c-b57c-5e1714783b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:36.425428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c6eedb38-a9d7-4b2c-b57c-5e1714783b98 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:36.426677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c6eedb38-a9d7-4b2c-b57c-5e1714783b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:36.525551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 228/457] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:36.565749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37c8c2-fb7b-48b2-b182-a692d9a45e6d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:36.603576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:36.706610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37c8c2-fb7b-48b2-b182-a692d9a45e6d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:36.753789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd6edd-4acd-4545-a08d-01e37d6f4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:36.754432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd6edd-4acd-4545-a08d-01e37d6f4466 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:36.754713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd6edd-4acd-4545-a08d-01e37d6f4466 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:36.754995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd6edd-4acd-4545-a08d-01e37d6f4466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:36.769633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd6edd-4acd-4545-a08d-01e37d6f4466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:36.771113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd6edd-4acd-4545-a08d-01e37d6f4466 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-1fdd6edd-4acd-4545-a08d-01e37d6f4466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:36.792362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:36.793629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:36.794647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:36.794647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:36.794647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:36.794647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:36.794647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 230/458] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:36.800324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eedb38-a9d7-4b2c-b57c-5e1714783b98 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:36.848522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf5b9-20a2-4c4c-80a9-4cf8cd86ade7 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:36.848811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf5b9-20a2-4c4c-80a9-4cf8cd86ade7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:36.849120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf5b9-20a2-4c4c-80a9-4cf8cd86ade7 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:36.850744 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 231/459] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:36.856081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b391b0f-e352-4c33-a5c5-74f8c5dd3d9a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:36.856536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b391b0f-e352-4c33-a5c5-74f8c5dd3d9a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:36.857011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b391b0f-e352-4c33-a5c5-74f8c5dd3d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:36.884666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-4b391b0f-e352-4c33-a5c5-74f8c5dd3d9a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:36.887062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4b391b0f-e352-4c33-a5c5-74f8c5dd3d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:36.988053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eedb38-a9d7-4b2c-b57c-5e1714783b98 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.002320 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 232/460] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:37.010511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f457f-3c96-4f0e-aeeb-baddc0ef49c4 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.011019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f457f-3c96-4f0e-aeeb-baddc0ef49c4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.012799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:37.013509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f457f-3c96-4f0e-aeeb-baddc0ef49c4 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.015332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 233/461] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:37.020011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c571-96f4-4cb4-8e7f-22a4d76be43d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.020472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c571-96f4-4cb4-8e7f-22a4d76be43d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.020910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c571-96f4-4cb4-8e7f-22a4d76be43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.041394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-4f67c571-96f4-4cb4-8e7f-22a4d76be43d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:37.043456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4f67c571-96f4-4cb4-8e7f-22a4d76be43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:37.052365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.053321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.053783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.053887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:37.054969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.055866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:37.056381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.058076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.071943 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 229/462] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:37.073149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.130026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 234/463] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:37.131335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67c571-96f4-4cb4-8e7f-22a4d76be43d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.241594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81e2f6-8147-434f-ae65-1d49bc8e58a4 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.279054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67c571-96f4-4cb4-8e7f-22a4d76be43d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.280077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.280788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.281113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.281392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.294967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.297141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:37.314970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:37.315861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:37.316685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:37.316685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:37.316685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:37.316685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:37.316685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 230/464] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:37.317559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.323269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0900-7bad-4a85-ac3a-5410f78299a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.325181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0900-7bad-4a85-ac3a-5410f78299a0 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.325181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0900-7bad-4a85-ac3a-5410f78299a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.325181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0900-7bad-4a85-ac3a-5410f78299a0 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.325181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0900-7bad-4a85-ac3a-5410f78299a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.326804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0900-7bad-4a85-ac3a-5410f78299a0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.338666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:37.345696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:37.405588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 235/465] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:04:37 2022] POST /identity/v3/users => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:37.407038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1cd43-3493-4dd4-8726-e1e9a415d46d None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.407398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1cd43-3493-4dd4-8726-e1e9a415d46d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.407745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1cd43-3493-4dd4-8726-e1e9a415d46d None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.414971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 236/466] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:37.415332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1cd43-3493-4dd4-8726-e1e9a415d46d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.444651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0e647-bf91-4da9-81fb-40b390fa5830 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.504363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b9784-db10-4bf6-90cc-23c04db88c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.505335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b9784-db10-4bf6-90cc-23c04db88c7b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.505740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b9784-db10-4bf6-90cc-23c04db88c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.506318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b9784-db10-4bf6-90cc-23c04db88c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.524745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b9784-db10-4bf6-90cc-23c04db88c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.526599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b9784-db10-4bf6-90cc-23c04db88c7b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-db7b9784-db10-4bf6-90cc-23c04db88c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:37.547797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:37.548905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:37.550032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:37.550032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:37.550032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:37.550032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:37.557979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 231/467] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:37.557979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ba14d-a118-4ede-b9b5-e209acd306c7 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.557979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ba14d-a118-4ede-b9b5-e209acd306c7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.557979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ba14d-a118-4ede-b9b5-e209acd306c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.580860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1cd43-3493-4dd4-8726-e1e9a415d46d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.583403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-5b2ba14d-a118-4ede-b9b5-e209acd306c7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:37.584610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5b2ba14d-a118-4ede-b9b5-e209acd306c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:37.628949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.629572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.629853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.630129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.630827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:37.631129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.634111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.651218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 237/468] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:37.651989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.682015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 232/469] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:37.683293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ba14d-a118-4ede-b9b5-e209acd306c7 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.695676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:37.735499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:37.795713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324411b-d127-469d-9a54-b2f1ec3caff8 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.821054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ba14d-a118-4ede-b9b5-e209acd306c7 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.838636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.839270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.839548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.839822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.840717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:37.841048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.843258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.859763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 238/470] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:37.860655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.868535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bb056-8006-428a-97d5-3260461ad556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.869634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb056-8006-428a-97d5-3260461ad556 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.870135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb056-8006-428a-97d5-3260461ad556 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.870632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb056-8006-428a-97d5-3260461ad556 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.871986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bb056-8006-428a-97d5-3260461ad556 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.874752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bb056-8006-428a-97d5-3260461ad556 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.965194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 233/471] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:04:37 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:37.967427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bb056-8006-428a-97d5-3260461ad556 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.022664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51e23-2bc5-441e-9498-9dc30e642ad4 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.051904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:38.080220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:38.082527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b446d-b304-4c70-8037-5781631bb737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.083509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b446d-b304-4c70-8037-5781631bb737 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.083835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b446d-b304-4c70-8037-5781631bb737 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.084111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b446d-b304-4c70-8037-5781631bb737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.098210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b446d-b304-4c70-8037-5781631bb737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.100338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b446d-b304-4c70-8037-5781631bb737 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-a04b446d-b304-4c70-8037-5781631bb737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:38.121892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:38.122788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:38.123614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:38.123614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:38.123614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:38.123614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:38.124258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 239/472] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:38.126110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9af6-ba60-4276-80ef-f551d438d62d None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.126776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9af6-ba60-4276-80ef-f551d438d62d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.127075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f9af6-ba60-4276-80ef-f551d438d62d None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.132966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 240/473] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:38.133863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9af6-ba60-4276-80ef-f551d438d62d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.137838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bb056-8006-428a-97d5-3260461ad556 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.188465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec697e11-71ea-49e2-94b2-98fbf07e6ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.189122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697e11-71ea-49e2-94b2-98fbf07e6ff4 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.189399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697e11-71ea-49e2-94b2-98fbf07e6ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.189948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697e11-71ea-49e2-94b2-98fbf07e6ff4 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.190577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec697e11-71ea-49e2-94b2-98fbf07e6ff4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.191884 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec697e11-71ea-49e2-94b2-98fbf07e6ff4 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.262860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f9af6-ba60-4276-80ef-f551d438d62d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.306349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.307389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.307851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.308333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.309236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:38.309718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.310383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 234/474] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:04:37 2022] POST /identity/v3/users => generated 248 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:38.311541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.311781 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd39516-59fd-4d68-9d82-b31e391bfa44 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.312071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd39516-59fd-4d68-9d82-b31e391bfa44 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.317356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd39516-59fd-4d68-9d82-b31e391bfa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.343907 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 241/475] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:38.349314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.359854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1fd39516-59fd-4d68-9d82-b31e391bfa44 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:38.363366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1fd39516-59fd-4d68-9d82-b31e391bfa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:38.397986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:38.523655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 235/476] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:38.529665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f789b-73c2-455e-a4f5-a39ad7faf5d8 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.551913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd39516-59fd-4d68-9d82-b31e391bfa44 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.567269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b8d79-87cb-4a41-a525-bdf88295f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.567814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b8d79-87cb-4a41-a525-bdf88295f861 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.568096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b8d79-87cb-4a41-a525-bdf88295f861 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.568369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b8d79-87cb-4a41-a525-bdf88295f861 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.569107 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b8d79-87cb-4a41-a525-bdf88295f861 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.571150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b8d79-87cb-4a41-a525-bdf88295f861 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.618688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:38.671727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 242/477] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:04:38 2022] POST /identity/v3/users => generated 249 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:38.678828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd39516-59fd-4d68-9d82-b31e391bfa44 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.729779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.730409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.730685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.730951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.731689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.733105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.772558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.sql.core [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 21:04:38.772558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 21:04:38.772558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [parameters: {'id': '5b63f5f94e954f9fa48a21b9afa9b20b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 21:04:38.772558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80840) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application conn.query(q) Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result.read() Aug 04 21:04:38.799491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 21:04:38.800435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application next(self.gen) Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application yield resource Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application next(self.gen) Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise self.value Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application session.commit() Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 21:04:38.801436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.session.flush() Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application compat.raise_( Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 21:04:38.802997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 21:04:38.805458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application conn.query(q) Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result.read() Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 21:04:38.806411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [parameters: {'id': '5b63f5f94e954f9fa48a21b9afa9b20b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:38.807332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 21:04:38.814034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:38.816025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 236/478] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Aug 4 21:04:38 2022] POST /identity/v3/roles => generated 144 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:38.816161 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b8d79-87cb-4a41-a525-bdf88295f861 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.936486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:38.958248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b8d79-87cb-4a41-a525-bdf88295f861 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.997247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2ea55-436c-45e8-9758-70f9580ba8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.998267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ea55-436c-45e8-9758-70f9580ba8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.998750 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ea55-436c-45e8-9758-70f9580ba8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.999250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2ea55-436c-45e8-9758-70f9580ba8b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.011228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2ea55-436c-45e8-9758-70f9580ba8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-d5b2ea55-436c-45e8-9758-70f9580ba8b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:39.016971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:39.017869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 21:04:39.018662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:39.021225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 243/479] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:04:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:39.029309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.147802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be001c91-4017-4733-bd5f-7576959bdbcd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.162634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:39.186370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417fa9-d381-4b5b-8f7a-2a7b5a868996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.187441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417fa9-d381-4b5b-8f7a-2a7b5a868996 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.187924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417fa9-d381-4b5b-8f7a-2a7b5a868996 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.188412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417fa9-d381-4b5b-8f7a-2a7b5a868996 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.189357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417fa9-d381-4b5b-8f7a-2a7b5a868996 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:39.189877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417fa9-d381-4b5b-8f7a-2a7b5a868996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.191444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417fa9-d381-4b5b-8f7a-2a7b5a868996 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.201501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 237/480] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:39.859960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30f5ee-f8c7-4d37-bff1-aee2188c984a None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.860500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30f5ee-f8c7-4d37-bff1-aee2188c984a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.860500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30f5ee-f8c7-4d37-bff1-aee2188c984a None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.862159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 244/481] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:39.867275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836db568-9757-4ea4-9d7b-4e9f514da779 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.867755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836db568-9757-4ea4-9d7b-4e9f514da779 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.867950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836db568-9757-4ea4-9d7b-4e9f514da779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.893918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-836db568-9757-4ea4-9d7b-4e9f514da779 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:39.895139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-836db568-9757-4ea4-9d7b-4e9f514da779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:39.987527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 238/482] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:40.024216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30f5ee-f8c7-4d37-bff1-aee2188c984a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:40.154312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30f5ee-f8c7-4d37-bff1-aee2188c984a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:40.202379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c7be-a422-475a-94ec-770e69cbc0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:40.203032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c7be-a422-475a-94ec-770e69cbc0ca None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.203312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c7be-a422-475a-94ec-770e69cbc0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.203585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c7be-a422-475a-94ec-770e69cbc0ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.217340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823c7be-a422-475a-94ec-770e69cbc0ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-0823c7be-a422-475a-94ec-770e69cbc0ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:40.222840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:40.223734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:40.224520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:40.228613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 245/483] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:40.237999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836db568-9757-4ea4-9d7b-4e9f514da779 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:40.381832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836db568-9757-4ea4-9d7b-4e9f514da779 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:40.384332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:40.407318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03bc1b-1e51-4c21-8aed-db4015c25ec4 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.407708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03bc1b-1e51-4c21-8aed-db4015c25ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.408171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03bc1b-1e51-4c21-8aed-db4015c25ec4 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.410749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 246/484] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:40.418045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ef08-8f72-4a99-bde6-cde55fac93fa None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.418330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ef08-8f72-4a99-bde6-cde55fac93fa None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.418608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ef08-8f72-4a99-bde6-cde55fac93fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.433793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:40.439067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c7e3ef08-8f72-4a99-bde6-cde55fac93fa None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:40.440448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c7e3ef08-8f72-4a99-bde6-cde55fac93fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:40.441571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:40.442203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.447016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.447016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.447016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:40.447016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:40.447016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:40.458681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 239/485] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:40.464451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:40.549465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 247/486] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:40.598256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3ef08-8f72-4a99-bde6-cde55fac93fa None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:40.679656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b222e1a-18a6-42b4-b141-597b03c7588b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:40.733993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:40.734622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.734900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.735172 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.748303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:40.749817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:40.765458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:40.766338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:40.767183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:40.767183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:40.767183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:40.767183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:40.767183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 240/487] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:40.773119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:40.793155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3ef08-8f72-4a99-bde6-cde55fac93fa None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:40.821266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:40.855778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc1405-1f81-44f5-8153-375178a3f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:40.856705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1405-1f81-44f5-8153-375178a3f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.857034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1405-1f81-44f5-8153-375178a3f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.857315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1405-1f81-44f5-8153-375178a3f5f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.859448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:40.872299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc1405-1f81-44f5-8153-375178a3f5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-25dc1405-1f81-44f5-8153-375178a3f5f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:40.878472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:40.879427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:40.880232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:40.880845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 248/488] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:40.886197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717a27-e13f-458a-8f22-6f8bf2e79399 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.886819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717a27-e13f-458a-8f22-6f8bf2e79399 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.887109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717a27-e13f-458a-8f22-6f8bf2e79399 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.888597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 249/489] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:40.890847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9717a27-e13f-458a-8f22-6f8bf2e79399 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:40.929532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff090-d6a3-4e17-92b7-1f77d747f814 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:40.967498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832275da-9ef3-413f-98e6-385658965fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:40.968033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832275da-9ef3-413f-98e6-385658965fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.968312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832275da-9ef3-413f-98e6-385658965fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.968582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832275da-9ef3-413f-98e6-385658965fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.969323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832275da-9ef3-413f-98e6-385658965fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:40.969625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832275da-9ef3-413f-98e6-385658965fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:40.971006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832275da-9ef3-413f-98e6-385658965fb0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:40.983859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 241/490] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:40.985135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575befe-028a-4171-9897-47ea610ebcb1 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.985422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575befe-028a-4171-9897-47ea610ebcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.985701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575befe-028a-4171-9897-47ea610ebcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.007937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4575befe-028a-4171-9897-47ea610ebcb1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:41.009522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4575befe-028a-4171-9897-47ea610ebcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:41.044049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9717a27-e13f-458a-8f22-6f8bf2e79399 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.091104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.091821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.092102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.092374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.093123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:41.093450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:41.095681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:41.111875 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 250/491] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:41.111875 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.114639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 242/492] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:41.115607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575befe-028a-4171-9897-47ea610ebcb1 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.127888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:41.187088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:41.225435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575befe-028a-4171-9897-47ea610ebcb1 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.237309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98d9c2-9746-4f7d-b3a6-bd5993bce6f0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.269567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.270330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.270676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.271020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.280235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.281140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.281618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.282083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.282388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:41.284089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:41.291303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:41.293804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:41.299992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:41.300825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:41.301707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:41.301707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:41.301707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:41.301707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:41.306728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 243/493] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:41.307679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:41.311580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:41.312436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:04:41.313370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:41.315669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 251/494] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:41.316634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.378917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:41.425886 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f5c84-af7b-4523-91a4-1553f6ea0536 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.432389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127c35d-48ec-4797-9c82-7082ceaf75d9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.454010 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:41.463859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93694b6e-25fe-4efd-a363-2b90dab1d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.464548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93694b6e-25fe-4efd-a363-2b90dab1d199 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.464832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93694b6e-25fe-4efd-a363-2b90dab1d199 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.465206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93694b6e-25fe-4efd-a363-2b90dab1d199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.476413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.476664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93694b6e-25fe-4efd-a363-2b90dab1d199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:41.477505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.477968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.478416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.479314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:41.479794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:41.481401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-93694b6e-25fe-4efd-a363-2b90dab1d199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:41.482881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:41.483768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:41.484559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 244/495] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:41.486111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93694b6e-25fe-4efd-a363-2b90dab1d199 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.504253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 252/496] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:41.505375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.605276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93694b6e-25fe-4efd-a363-2b90dab1d199 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.622531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb2fab-40f5-4f74-90c1-936f809531df None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.631810 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:41.648184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea0091-9dcb-4cf3-aa94-319dbb35f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.649119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea0091-9dcb-4cf3-aa94-319dbb35f2bf None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.649538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea0091-9dcb-4cf3-aa94-319dbb35f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.654935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea0091-9dcb-4cf3-aa94-319dbb35f2bf None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.654935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea0091-9dcb-4cf3-aa94-319dbb35f2bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:41.654935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea0091-9dcb-4cf3-aa94-319dbb35f2bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:41.654935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea0091-9dcb-4cf3-aa94-319dbb35f2bf None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:41.658657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.659261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.659536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.659799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.660500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:41.660843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:41.662426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:41.672726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 253/497] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:41.673923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.702737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 245/498] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:41.702737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff023fa-5ed2-47e2-ba7e-7b7a18fee83f None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.702737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff023fa-5ed2-47e2-ba7e-7b7a18fee83f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.702737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff023fa-5ed2-47e2-ba7e-7b7a18fee83f None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.702737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 246/499] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:41.702737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff023fa-5ed2-47e2-ba7e-7b7a18fee83f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.725606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:41.794803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb5c7e-ebe9-4431-94a4-8a2f1d5dba7a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.818905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff023fa-5ed2-47e2-ba7e-7b7a18fee83f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.828390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.829063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.829345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.829618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.838470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:41.840398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:41.852106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:41.853078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:41.853938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 254/500] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:41.855081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:41.863927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352c23-0ee4-4182-b299-1d66e00fac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:41.864569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352c23-0ee4-4182-b299-1d66e00fac9b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.864848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352c23-0ee4-4182-b299-1d66e00fac9b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.865150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352c23-0ee4-4182-b299-1d66e00fac9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.877042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352c23-0ee4-4182-b299-1d66e00fac9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:41.878514 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352c23-0ee4-4182-b299-1d66e00fac9b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-e1352c23-0ee4-4182-b299-1d66e00fac9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:41.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:41.895162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:41.896009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:41.896009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:41.896009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:41.896009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:41.896009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 247/501] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:41.897022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66638dee-914b-439d-876c-c33bf54e95e0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:41.897288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66638dee-914b-439d-876c-c33bf54e95e0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:41.897560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66638dee-914b-439d-876c-c33bf54e95e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:41.916958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-66638dee-914b-439d-876c-c33bf54e95e0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:41.918512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-66638dee-914b-439d-876c-c33bf54e95e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:41.942832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:41.981338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:41.985736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e200457-1f60-41c8-956b-507bbe39776c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:41.997878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 248/502] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:41.997878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66638dee-914b-439d-876c-c33bf54e95e0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.030443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a37a9-f953-4992-9aaf-e34c30f455fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.031064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a37a9-f953-4992-9aaf-e34c30f455fb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.031346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a37a9-f953-4992-9aaf-e34c30f455fb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.031968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a37a9-f953-4992-9aaf-e34c30f455fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.097621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66638dee-914b-439d-876c-c33bf54e95e0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.102140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a37a9-f953-4992-9aaf-e34c30f455fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.103613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a37a9-f953-4992-9aaf-e34c30f455fb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:42.131692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.132866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.133254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.133529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.134296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:42.134603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.136034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:42.154451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 249/503] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:42.155286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.174096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:42.208109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:42.213401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 255/504] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:42.214724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731629-b8a1-4e14-a8d0-bf66314248ee None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.215046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731629-b8a1-4e14-a8d0-bf66314248ee None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.215323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731629-b8a1-4e14-a8d0-bf66314248ee None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.216742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 256/505] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:42.217276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3731629-b8a1-4e14-a8d0-bf66314248ee None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.264773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270be71-6b18-427c-a21b-a1cd6be019e4 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.301122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.301740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.302015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.302282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.302961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:42.303259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.305320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:42.316415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 250/506] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:42.317237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.327776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3731629-b8a1-4e14-a8d0-bf66314248ee None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.362902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca25163-69d8-4ba7-aeab-dde89cd96e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.363518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca25163-69d8-4ba7-aeab-dde89cd96e6d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.363798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca25163-69d8-4ba7-aeab-dde89cd96e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.364070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca25163-69d8-4ba7-aeab-dde89cd96e6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.375156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca25163-69d8-4ba7-aeab-dde89cd96e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-aca25163-69d8-4ba7-aeab-dde89cd96e6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:42.379995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:42.380866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:42.381721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 257/507] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:42.382361 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca25163-69d8-4ba7-aeab-dde89cd96e6d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.405857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:42.433315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09db48e-60ca-425d-8a51-1ee9c1be8dbf None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.446027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:42.472572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23e68-4be5-425c-b105-9ef11ad8ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.473215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23e68-4be5-425c-b105-9ef11ad8ca11 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.473497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23e68-4be5-425c-b105-9ef11ad8ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.473773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23e68-4be5-425c-b105-9ef11ad8ca11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.494392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca25163-69d8-4ba7-aeab-dde89cd96e6d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.530915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48a45d-509d-47d9-981a-c7113e8f26e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.531553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48a45d-509d-47d9-981a-c7113e8f26e7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.531829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48a45d-509d-47d9-981a-c7113e8f26e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.532098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48a45d-509d-47d9-981a-c7113e8f26e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.543579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48a45d-509d-47d9-981a-c7113e8f26e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.545072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48a45d-509d-47d9-981a-c7113e8f26e7 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:42.546766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c23e68-4be5-425c-b105-9ef11ad8ca11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.548205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c23e68-4be5-425c-b105-9ef11ad8ca11 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-7a48a45d-509d-47d9-981a-c7113e8f26e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:42.560538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:42.561439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:42.562292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:42.562292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:42.562292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:42.562292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:42.562292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 258/508] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:42.562985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2947-595e-4fdd-8cf2-561f55f75e77 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.563263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2947-595e-4fdd-8cf2-561f55f75e77 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.563528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa2947-595e-4fdd-8cf2-561f55f75e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.581181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-a9fa2947-595e-4fdd-8cf2-561f55f75e77 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:42.582365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a9fa2947-595e-4fdd-8cf2-561f55f75e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:42.629106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:42.651371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 259/509] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:42.652218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2947-595e-4fdd-8cf2-561f55f75e77 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.656970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 251/510] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:42.657719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23e68-4be5-425c-b105-9ef11ad8ca11 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.708321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:42.760207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23e68-4be5-425c-b105-9ef11ad8ca11 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.769086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa2947-595e-4fdd-8cf2-561f55f75e77 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.794751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.795433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.795658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.795908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.796610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:42.796933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.798303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:42.805916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.806558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.806839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.807116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.807301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 252/511] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:42.808165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.817210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.818657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:42.830955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:42.831910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 260/512] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:42.832813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.855833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:42.918237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b5cc-3a01-4afe-930e-1152bec01f92 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.936769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:42.939650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90288190-46cc-49cc-bf8b-50586e60ab40 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:42.953444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.954063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.954337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.954608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.955291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:42.955593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.956990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:42.969433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 253/513] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:42.970269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:42.973670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:42.974427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:42.974711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:42.974987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:42.986915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:42.988385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:43.003600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:43.004487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:43.005393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:43.005393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:43.005393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:43.005393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:43.009858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 261/514] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:43.010616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.071222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:43.074149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c307-3201-453b-b8e2-4a79ec869dfd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.109465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.110244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.110340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.110590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.115729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3291661-6175-4e4c-a8c6-cdc61c6fac5e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.121680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.123175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:43.137820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:43.138701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:43.139548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:43.139548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:43.139548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:43.139548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:43.139548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 254/515] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:43.139819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.157898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.158544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.158826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.159101 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.171175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.172561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:43.187758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:43.188800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:43.189861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:43.189861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:43.189861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:43.189861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:43.189861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 262/516] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:43.189861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.196770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:43.245635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b47ff-6e59-4b47-a928-e51e86446124 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.279998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.280611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.280910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.281185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.281974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:43.282282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.283711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.295424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1004b9e-6340-4691-97f4-63f3d89c2881 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.307243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 255/517] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:43.308165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.323915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:43.334288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.334288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.334288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.334288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.339583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.341064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:43.353089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:43.353985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:43.354825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 263/518] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:43.355463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.421394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:43.421608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be191d-6ac9-471b-86d1-0f85665e7609 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.457137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.457757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.458034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.458318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.459002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:43.459304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.460783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.461662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbd858-2662-473b-a8fd-0dd71eca363c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.472581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 256/519] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:43.473471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.500164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.500784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.501103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.501372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.502058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:43.502336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.503718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.517424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 264/520] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:43.518327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.547414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:43.579858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8548-2374-45c1-9573-9dd458b3005a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.613610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.614220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.614493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.614761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.615433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:43.615732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.617926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.619408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c16af-565a-490a-be3c-584928c9b4c5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.629617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 257/521] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:43.630447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.646828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:43.657534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941ae4-771f-46af-9987-303868576340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.669765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941ae4-771f-46af-9987-303868576340 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.669765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941ae4-771f-46af-9987-303868576340 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.669765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941ae4-771f-46af-9987-303868576340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.729550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3941ae4-771f-46af-9987-303868576340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.730960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3941ae4-771f-46af-9987-303868576340 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.736933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e1baa-658a-4245-9050-a3dc8815dd8e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.772063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:43.778111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.778734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.779020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.779293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.780047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:43.780352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.781827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.801726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 258/522] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:43.802369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.832734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 265/523] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:43.833600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941ae4-771f-46af-9987-303868576340 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.859118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:43.906254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859a8a4-34c3-477d-9d15-8a78269d5eba None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.936378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941ae4-771f-46af-9987-303868576340 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.941711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.942353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.942634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.942914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.949838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.951306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:43.963444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:43.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 259/524] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:43.965988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.974938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17693f-f818-4f6d-b198-cdb9b00d1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.975562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17693f-f818-4f6d-b198-cdb9b00d1807 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.976407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17693f-f818-4f6d-b198-cdb9b00d1807 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.976681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17693f-f818-4f6d-b198-cdb9b00d1807 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.977522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17693f-f818-4f6d-b198-cdb9b00d1807 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.978987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17693f-f818-4f6d-b198-cdb9b00d1807 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.015997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:44.061242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 266/525] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:04:43 2022] POST /identity/v3/users => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:44.062134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17693f-f818-4f6d-b198-cdb9b00d1807 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.067735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601e9e-758c-4e9a-a1f2-db83d4eb20fb None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.111451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.112117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.112397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.112667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.122533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.124038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:44.138518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:44.139757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 260/526] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:44.140653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.183727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:44.207021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17693f-f818-4f6d-b198-cdb9b00d1807 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.260923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.261826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.262312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.262751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.263637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=66a82e8f2e304418adce1935fe7abcb8) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:44.263878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.266983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.276851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 267/527] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/role_assignments?user.id=66a82e8f2e304418adce1935fe7abcb8&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:44.277752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.278831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341555-d4b5-4fce-b705-cce1721e0e1e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.293656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:44.332094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.332779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.333095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.333371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.349652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.352020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:44.373789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:44.374739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:44.375590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:44.375590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:44.375590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:44.375590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:44.377840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 261/528] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:44.377840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.439303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ff74-aa1c-4636-a00b-175a6500f315 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.486191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.487172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.487654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.488125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.489136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:44.489644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.491348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.516043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 268/529] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:44.516957 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.521592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:44.531038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02146940-b294-4c6e-afe2-1f7c3ee9d3a0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.580230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.581503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.581985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.582606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.584524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:44.585154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.588241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.612729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 262/530] 10.222.0.93 () {56 vars in 1139 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:44.613999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.638210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3e29-9de0-402d-9429-af028a5f2cb3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.642233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:44.675783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.676408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.676685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.676983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.677922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:44.678472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.680418 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.693024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 269/531] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:44.693966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.759547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca746-bd57-47e3-a576-e695f0beef52 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.771225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:44.808655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.810304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.810978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.811788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.813124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=3ad56212b530461cb19f1bb2b4b14027) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:44.813785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.816100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.817704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb959-e8d5-4403-926d-5583af05d229 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.825069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 263/532] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/role_assignments?user.id=3ad56212b530461cb19f1bb2b4b14027&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:44.826286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.915032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd62c00-9ac3-4c3b-9441-445ecb75bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.915777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd62c00-9ac3-4c3b-9441-445ecb75bf67 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.916056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd62c00-9ac3-4c3b-9441-445ecb75bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.916452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd62c00-9ac3-4c3b-9441-445ecb75bf67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:45.004420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:45.043134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e58dee-fc19-4918-80de-c85c988bae39 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:45.067611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd62c00-9ac3-4c3b-9441-445ecb75bf67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:45.069064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd62c00-9ac3-4c3b-9441-445ecb75bf67 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:45.092216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:45.093846 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:45.094458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:45.094950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:45.106289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:45.108348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:45.121634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:45.122502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:45.123334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:45.123334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:45.123334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:45.123334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:45.123334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:45.123334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:45.123334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:45.123334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:45.126060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 264/533] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:45.131047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:45.227622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:45.308336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 270/534] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:45.311485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b80e-1b3f-4028-8ab9-f22809c8e3ab None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:45.313602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd62c00-9ac3-4c3b-9441-445ecb75bf67 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:45.382904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:45.383446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:45.383881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:45.384166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:45.384957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:45.385273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:45.400477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:45.418424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 265/535] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:45.426900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:45.439031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:45.493514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd62c00-9ac3-4c3b-9441-445ecb75bf67 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:45.532833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:45.533699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:45.533990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:45.534392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:45.546876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:45.549028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:45.565624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:45.566497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:45.567770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:45.567770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:45.567770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:45.567770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:45.567770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 271/536] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:45.573564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:45.595878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:45.651617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491e41f-3224-4b6a-9a9d-16e174467fb6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:45.703288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:45.704043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:45.704386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:45.704724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:45.705624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=3771fe71ef624fd38dcaf2bff3751663) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:45.706000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:45.707598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:45.714214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 266/537] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:45 2022] GET /identity/v3/role_assignments?user.id=3771fe71ef624fd38dcaf2bff3751663&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:45.725312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e020fa-20c9-488f-bbe9-6d302499273b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:45.789726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:45.790455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:45.790744 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:45.791019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:45.791725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:45.792030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:45.793689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:45.811123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 272/538] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:45.816931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:45.893250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:45.934417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb6186-430b-4b93-9ada-7e25401b2a63 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:45.976465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:45.977428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:45.977703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:45.977971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:45.985395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:45.986843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:45.999645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:46.001687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:46.003761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 267/539] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:46.008906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:46.097261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:46.121647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66394-a644-4884-bcbf-bcae676ea665 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:46.158158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7533b-f380-4a54-b6ca-a1606741a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:46.158780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7533b-f380-4a54-b6ca-a1606741a905 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:46.159055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7533b-f380-4a54-b6ca-a1606741a905 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:46.159325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7533b-f380-4a54-b6ca-a1606741a905 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:46.160072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7533b-f380-4a54-b6ca-a1606741a905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:46.160375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7533b-f380-4a54-b6ca-a1606741a905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:46.161985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7533b-f380-4a54-b6ca-a1606741a905 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:46.175529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 273/540] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:46.181784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:46.330409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53840206-36bf-439c-910d-ced29671bfcb None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:46.371571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:46.379991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2aef67-eb21-4c26-bfb2-4fb8ea72aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:46.380876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aef67-eb21-4c26-bfb2-4fb8ea72aed7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:46.381337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aef67-eb21-4c26-bfb2-4fb8ea72aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:46.381847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aef67-eb21-4c26-bfb2-4fb8ea72aed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:46.383101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aef67-eb21-4c26-bfb2-4fb8ea72aed7 None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=a67b35a2567941f59dd746a3813b9d7a) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:46.383586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aef67-eb21-4c26-bfb2-4fb8ea72aed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:46.385210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aef67-eb21-4c26-bfb2-4fb8ea72aed7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:46.393870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 268/541] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:46 2022] GET /identity/v3/role_assignments?user.id=a67b35a2567941f59dd746a3813b9d7a&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:46.706172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b42ad6-fb8b-4ba6-b3b1-ae7e3f8de8af None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:46.706512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b42ad6-fb8b-4ba6-b3b1-ae7e3f8de8af None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:46.706687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b42ad6-fb8b-4ba6-b3b1-ae7e3f8de8af None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:46.708287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 274/542] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:46.714474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a4d0-fb1e-4cbd-a3f6-576cc007ff84 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:46.714765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a4d0-fb1e-4cbd-a3f6-576cc007ff84 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:46.715043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a4d0-fb1e-4cbd-a3f6-576cc007ff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:46.736541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1db7a4d0-fb1e-4cbd-a3f6-576cc007ff84 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:46.737768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1db7a4d0-fb1e-4cbd-a3f6-576cc007ff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:46.802864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdad23-d9ed-469f-ad7c-fa886468c761 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:46.803163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdad23-d9ed-469f-ad7c-fa886468c761 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:46.803415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdad23-d9ed-469f-ad7c-fa886468c761 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:46.809339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 275/543] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:46.814541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90cd8d-06f4-461d-931b-fd361d2b4b48 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:46.814831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90cd8d-06f4-461d-931b-fd361d2b4b48 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:46.815108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90cd8d-06f4-461d-931b-fd361d2b4b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:46.818459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 269/544] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:46.843825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7a4d0-fb1e-4cbd-a3f6-576cc007ff84 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:46.849911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ca90cd8d-06f4-461d-931b-fd361d2b4b48 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:46.851793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ca90cd8d-06f4-461d-931b-fd361d2b4b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:46.990178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 276/545] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:47.004471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7a4d0-fb1e-4cbd-a3f6-576cc007ff84 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:47.030285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90cd8d-06f4-461d-931b-fd361d2b4b48 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:47.040045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:47.065296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783756dc-21f8-490e-adc2-1323edc74181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:47.066324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783756dc-21f8-490e-adc2-1323edc74181 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.066815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783756dc-21f8-490e-adc2-1323edc74181 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.067293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783756dc-21f8-490e-adc2-1323edc74181 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.088331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783756dc-21f8-490e-adc2-1323edc74181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-783756dc-21f8-490e-adc2-1323edc74181 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:47.095487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:47.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:47.097311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:47.102790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 270/546] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:47.121945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783756dc-21f8-490e-adc2-1323edc74181 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:47.142852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:47.185523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90cd8d-06f4-461d-931b-fd361d2b4b48 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:47.239249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7012cc-7bee-495e-a95a-75aca2f88276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:47.240392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7012cc-7bee-495e-a95a-75aca2f88276 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.240969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7012cc-7bee-495e-a95a-75aca2f88276 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.242553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7012cc-7bee-495e-a95a-75aca2f88276 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.265455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7012cc-7bee-495e-a95a-75aca2f88276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-fb7012cc-7bee-495e-a95a-75aca2f88276 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:47.272294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:47.273852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:47.274822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:47.278739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 277/547] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:47.287319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7012cc-7bee-495e-a95a-75aca2f88276 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:47.355944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783756dc-21f8-490e-adc2-1323edc74181 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:47.428742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a59fc-56ed-4dca-9710-7bc5aeadd76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:47.429489 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a59fc-56ed-4dca-9710-7bc5aeadd76c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.429757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a59fc-56ed-4dca-9710-7bc5aeadd76c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.430021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a59fc-56ed-4dca-9710-7bc5aeadd76c None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.430844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a59fc-56ed-4dca-9710-7bc5aeadd76c None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:47.431143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a59fc-56ed-4dca-9710-7bc5aeadd76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:47.432612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a59fc-56ed-4dca-9710-7bc5aeadd76c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:47.441838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 271/548] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:47.443050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2acb5c-597d-465b-8c44-7a35a659916b None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.443329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2acb5c-597d-465b-8c44-7a35a659916b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.443621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2acb5c-597d-465b-8c44-7a35a659916b None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.449584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 272/549] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:47.450521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2acb5c-597d-465b-8c44-7a35a659916b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:47.459343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7012cc-7bee-495e-a95a-75aca2f88276 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:47.486918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:47.510848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:47.515081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f30c0-2de9-41d2-bc76-7c6c915a89b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:47.516283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f30c0-2de9-41d2-bc76-7c6c915a89b1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.516772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f30c0-2de9-41d2-bc76-7c6c915a89b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.517329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f30c0-2de9-41d2-bc76-7c6c915a89b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.518936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f30c0-2de9-41d2-bc76-7c6c915a89b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:47.519944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f30c0-2de9-41d2-bc76-7c6c915a89b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:47.522631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f30c0-2de9-41d2-bc76-7c6c915a89b1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:47.540932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 278/550] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:47.540932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d545-b366-4318-a1b0-2398038b16e5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.540932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d545-b366-4318-a1b0-2398038b16e5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.540932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d545-b366-4318-a1b0-2398038b16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.565538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-88d1d545-b366-4318-a1b0-2398038b16e5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:47.566732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-88d1d545-b366-4318-a1b0-2398038b16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:47.581073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2acb5c-597d-465b-8c44-7a35a659916b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:47.624908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:47.626186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.626667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.627152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.641932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:47.643797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:47.649170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 279/551] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:47.650205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d545-b366-4318-a1b0-2398038b16e5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:47.664734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:47.667197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:47.669192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:47.669192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:47.669192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:47.669192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:47.671734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 273/552] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:47.681140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:47.780217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d545-b366-4318-a1b0-2398038b16e5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:47.791233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:47.797839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c22dc-2a2e-40e4-bea4-1e978f334d40 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:47.801634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:47.822570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:47.823475 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.823908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.824344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.835826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:47.836547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:47.837278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:47.837650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:47.838136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:47.838758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:47.839378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:47.839493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:47.841329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:47.855061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 274/553] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:47.856105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:47.857663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:47.858489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:47.859342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:47.859342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:47.859342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:47.859342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:47.861698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 280/554] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:47.862703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:47.974073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4fb08-63aa-4194-821d-b7168889652b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:47.975296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd474-60bb-46f0-8ce6-943226deb67b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.011600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b668d-4df2-457e-aab3-ee3e72d41da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.012299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b668d-4df2-457e-aab3-ee3e72d41da2 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.012606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b668d-4df2-457e-aab3-ee3e72d41da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.012874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b668d-4df2-457e-aab3-ee3e72d41da2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.013802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.014706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.015257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.015830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.025433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:48.026207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b668d-4df2-457e-aab3-ee3e72d41da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:48.027424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-bb8b668d-4df2-457e-aab3-ee3e72d41da2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:48.033036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:48.033929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:48.034738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 275/555] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:48.035420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b668d-4df2-457e-aab3-ee3e72d41da2 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:48.046190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:48.047244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:04:48.048170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:48.051419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 281/556] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:04:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:48.052678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.057828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.087764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.162208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b668d-4df2-457e-aab3-ee3e72d41da2 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.178963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698239e-cdd5-4268-ac6c-b906284f7512 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.204012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.204906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.205210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.205472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.206319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:48.206933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:48.208977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:48.216103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfbd04-bbae-4041-9217-5fc222bd7363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.216974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbd04-bbae-4041-9217-5fc222bd7363 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.217099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbd04-bbae-4041-9217-5fc222bd7363 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.217372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbd04-bbae-4041-9217-5fc222bd7363 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.218342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfbd04-bbae-4041-9217-5fc222bd7363 None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:48.218342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfbd04-bbae-4041-9217-5fc222bd7363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:48.219878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfbd04-bbae-4041-9217-5fc222bd7363 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:48.225961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 276/557] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:48.227649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.230839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 282/558] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:48.230839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc78ee-a940-4d22-9828-e923655fa6af None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.231089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc78ee-a940-4d22-9828-e923655fa6af None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.231308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc78ee-a940-4d22-9828-e923655fa6af None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.232630 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 283/559] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:48.236680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc78ee-a940-4d22-9828-e923655fa6af None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.325791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.349862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.350047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5148d92-3c43-4ee9-b260-bb068884ba0a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.360936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc78ee-a940-4d22-9828-e923655fa6af None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.392032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.392655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.392961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.393272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.394028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:48.394334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:48.395787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:48.401813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63629623-cc8a-4132-bdce-79695e2aa6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.402701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63629623-cc8a-4132-bdce-79695e2aa6be None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.403235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63629623-cc8a-4132-bdce-79695e2aa6be None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.403687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63629623-cc8a-4132-bdce-79695e2aa6be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.415262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 277/560] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:48.415923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63629623-cc8a-4132-bdce-79695e2aa6be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:48.416112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.418919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63629623-cc8a-4132-bdce-79695e2aa6be None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-63629623-cc8a-4132-bdce-79695e2aa6be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:48.435984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:48.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:04:48.438290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:48.440273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 284/561] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:48.441671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94206807-e735-48d8-a6b9-3693328acc14 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.441958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94206807-e735-48d8-a6b9-3693328acc14 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.442232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94206807-e735-48d8-a6b9-3693328acc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.461653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-94206807-e735-48d8-a6b9-3693328acc14 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:48.462862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-94206807-e735-48d8-a6b9-3693328acc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:48.545362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 285/562] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:48.546280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94206807-e735-48d8-a6b9-3693328acc14 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.557596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ad4f2-8f7e-47f4-b3a6-0f78c2539a38 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.602802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.603312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.603587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.603865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.606163 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.617628 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:48.619752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:48.635110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:48.636223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:48.637170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:48.637170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:48.637170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:48.637170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:48.637170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 278/563] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:48.637460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.645595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.665528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94206807-e735-48d8-a6b9-3693328acc14 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.701122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0712a-cce9-450b-8c57-0506e8045498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.701740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0712a-cce9-450b-8c57-0506e8045498 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.702016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0712a-cce9-450b-8c57-0506e8045498 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.702288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0712a-cce9-450b-8c57-0506e8045498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.742332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e643d-19f1-41d6-b4aa-aba84c2fd73e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.775127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0712a-cce9-450b-8c57-0506e8045498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:48.776592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0712a-cce9-450b-8c57-0506e8045498 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:48.778827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.779444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.779714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.779983 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.780756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:48.781087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:48.782492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:48.800989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 279/564] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:48.801731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.850151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.874540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:48.896013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 286/565] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:48.898008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104f6a3-8f08-424a-bd21-ff34fc6652f3 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.899334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104f6a3-8f08-424a-bd21-ff34fc6652f3 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.900053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104f6a3-8f08-424a-bd21-ff34fc6652f3 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.901424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 287/566] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:48.906009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104f6a3-8f08-424a-bd21-ff34fc6652f3 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:48.913211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3502540-46eb-4804-9411-bd7b76e758da None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:48.952954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d85ef8-0aaf-498f-9344-2a8a9ab9c727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:48.953602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d85ef8-0aaf-498f-9344-2a8a9ab9c727 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:48.953887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d85ef8-0aaf-498f-9344-2a8a9ab9c727 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:48.954158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d85ef8-0aaf-498f-9344-2a8a9ab9c727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:48.965762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d85ef8-0aaf-498f-9344-2a8a9ab9c727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-27d85ef8-0aaf-498f-9344-2a8a9ab9c727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:48.970757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:48.971687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 280/567] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:48.973088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d85ef8-0aaf-498f-9344-2a8a9ab9c727 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.024310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104f6a3-8f08-424a-bd21-ff34fc6652f3 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.058733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.059465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.059741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.060014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.060702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:49.061040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.062406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.074735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 288/568] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:49.075527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.077139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d85ef8-0aaf-498f-9344-2a8a9ab9c727 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.080408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.113709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14402c46-519f-4449-9db3-b4e396667679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.114096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402c46-519f-4449-9db3-b4e396667679 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.114702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402c46-519f-4449-9db3-b4e396667679 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.114974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402c46-519f-4449-9db3-b4e396667679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.121229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.125927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14402c46-519f-4449-9db3-b4e396667679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.127329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14402c46-519f-4449-9db3-b4e396667679 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-14402c46-519f-4449-9db3-b4e396667679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:49.142892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:49.143814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:49.144702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:49.144702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:49.144702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:49.144702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:49.144702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 281/569] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:49.145204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394058-44ae-4e44-ad65-3f67ba8d2375 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.145480 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394058-44ae-4e44-ad65-3f67ba8d2375 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.145750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64394058-44ae-4e44-ad65-3f67ba8d2375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.164876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-64394058-44ae-4e44-ad65-3f67ba8d2375 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:49.166157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-64394058-44ae-4e44-ad65-3f67ba8d2375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:49.182764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2aefc-a33b-468e-8b02-8ecd98759ba0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.218662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.219302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.219579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.219848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.230156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.231593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.234708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 282/570] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:49.235544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394058-44ae-4e44-ad65-3f67ba8d2375 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:49.248104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:49.249100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:49.250017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:49.250017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:49.250017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:49.250017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:49.250017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 289/571] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:49.250470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.340421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.355263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64394058-44ae-4e44-ad65-3f67ba8d2375 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.359308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.366566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ad4f6-0aa0-4729-8298-e02fee218861 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.402336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.402896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.403174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.403505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] PATH_INFO: `/v3/users/glance` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.404093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.404705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.405013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.405283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.405995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:49.406293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.407653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.411751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.414049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.416677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 283/572] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:49.417795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:49.427879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:49.429214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 290/573] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:49.430484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.521476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa5c13-1735-43ba-b0d4-d7de610e2a9e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.533817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089018-f773-4bac-b084-5d325dce1dca None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.558728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.559544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.559874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.560175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.560868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:49.561202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.562569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.569743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.570449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.570729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.571001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.571685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:49.571981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.573363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.579028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 284/574] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:49.579028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.585719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 291/575] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:49.586671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.589779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.604303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.683737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b973f29-71cc-42da-abaf-df9ba534c0d0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.690793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676791-b32a-4864-b8b4-a1eb36a77af5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.720426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d038b2e-cc7f-456f-88ef-3d73690ee5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.721109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d038b2e-cc7f-456f-88ef-3d73690ee5ba None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.721383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d038b2e-cc7f-456f-88ef-3d73690ee5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.721647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d038b2e-cc7f-456f-88ef-3d73690ee5ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.726464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.727108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.727386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.727656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.731558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d038b2e-cc7f-456f-88ef-3d73690ee5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-3d038b2e-cc7f-456f-88ef-3d73690ee5ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:49.736413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:49.737508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:49.743560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 285/576] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:49.744291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.744368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d038b2e-cc7f-456f-88ef-3d73690ee5ba None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.744436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:49.760939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:49.761913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:49.762790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:49.762790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:49.762790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:49.762790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:49.762790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 292/577] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:49.763096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.816871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.832780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:49.851056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d038b2e-cc7f-456f-88ef-3d73690ee5ba None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.868057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06faf-96ec-4965-9c28-a5115fa53a9d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:49.886402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.887010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.887285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.887553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.888355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:49.888652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.890108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.903849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:49.904488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:49.904771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:49.905073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:49.908641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 286/578] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:49.909576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:49.912460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:49.914296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:49.926509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:49.927592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:49.928600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 293/579] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:49.929340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.018374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72eed6-e6b6-40f1-9933-980233cfdbeb None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.034818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85364483-a8c0-48a5-988a-c6d334dd5e81 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.046008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.054232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.054858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.055135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.055412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.062219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.063661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.064116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.072765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.073408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.073690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.073962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.074668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:50.074969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:50.075573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:50.076540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:50.077925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:50.077925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:50.077925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:50.077925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:50.077925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:50.077925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:50.077925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:50.077925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:50.078362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.078434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 287/580] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:50.078434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.089784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 294/581] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:50.090607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.180660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b802e5-a38e-4f16-ac22-5dd340ce5ce6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.193069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e9783-cee1-425b-8227-3abaab6d5b5e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.215696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.216314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.216596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.216870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.217583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:50.217885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.219251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.228188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.228827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.229131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.229407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.231537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 288/582] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:50.232326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.240567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.241797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:50.257409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:50.258364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:50.259243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:50.259243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:50.259243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:50.259243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:50.259243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 295/583] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:50.259526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.285760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.304530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.341140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496ab5c-b36d-48df-a423-6603e7c85d19 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.364569 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5272d8-0891-47c5-befe-906bb1bdf4d6 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.375864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.376473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.376745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.377047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.377774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:50.378074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.379476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.391841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 289/584] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:50.392629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.413020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.413775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.414048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.414316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.415054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:50.415354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.416778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.435050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 296/585] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:50.435050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.504600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1df3-8336-4fd7-9f62-db7a90a356df None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.512916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.534286 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.537124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee437fc6-d081-42d1-ae98-11fb37e7284d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.539647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.540294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.540576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.540849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.551601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.553083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:50.568105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:50.569629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:50.570970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:50.570970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:50.570970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:50.570970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:50.570970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 290/586] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:50.570970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.577048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.577698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.577974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.578240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.586545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.587976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:50.601758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:50.602782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 297/587] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:50.603760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.680936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3dee-d520-4201-8f89-ddb0624559ba None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.704503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb13d-6369-4623-ab55-8bced8794848 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.715544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.716188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.716464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.716733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.717451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:50.717750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.719101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.730933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 291/588] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:50.731853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.744241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5f72a-13a8-450d-9555-76572937b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.744940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5f72a-13a8-450d-9555-76572937b54b None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.745224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5f72a-13a8-450d-9555-76572937b54b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.745492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5f72a-13a8-450d-9555-76572937b54b None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/66a82e8f2e304418adce1935fe7abcb8/roles/7647001353b54c2789f738144d1189c7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.750608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.761027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5f72a-13a8-450d-9555-76572937b54b None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=66a82e8f2e304418adce1935fe7abcb8, role_id=7647001353b54c2789f738144d1189c7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.774247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5f72a-13a8-450d-9555-76572937b54b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.831207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181289d4-d88d-4bce-a3ef-797244673f72 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.850106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 298/589] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:50 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/66a82e8f2e304418adce1935fe7abcb8/roles/7647001353b54c2789f738144d1189c7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:50.851159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5f72a-13a8-450d-9555-76572937b54b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.864420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.878667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.879730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.880017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.880359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.881263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=348efd4e6a0948afb8b0015d9bfb1d08) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:50.881702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.884148 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.900930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 292/590] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/role_assignments?user.id=348efd4e6a0948afb8b0015d9bfb1d08&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:50.900930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.000132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.013965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5f72a-13a8-450d-9555-76572937b54b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.027172 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74641-3611-49bf-8b19-8eed114b336a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.063056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.063683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.063960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.064231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.065008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:51.065287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.066700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.074378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.075348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.075859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.076299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.077315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:51.078232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.079870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.087794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 299/591] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:51.089192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.106441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 293/592] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:51.107530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.178700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.218890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8431689-1c19-478f-aeef-45f993660dfd None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.229564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe40c-710e-4704-90dd-1b6693be804a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.257850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.258497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.258777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.259047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.266621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.268088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.268819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.269761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.270300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.270941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.280732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:51.281223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:51.282270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 300/593] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:51.283265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.285164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.288360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:51.299053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:51.300259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 294/594] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:51.301266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.410921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac9cfa-b36e-4ca8-90ac-a73b3d0c875c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.415167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e898-7994-42e7-845e-d2d364dcc85a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.451445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.452063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.452333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.452599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.452691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.456717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:51.456717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.456717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.459372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.460407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.460960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.461400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.468774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 295/595] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:51.469644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.477330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.479178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:51.504763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:51.506428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:51.507525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:51.507525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:51.507525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:51.507525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:51.507525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 301/596] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:51.507525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.555000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.602785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b9e9-f549-4ec8-84c6-3fb24bfbdaf6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.629446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869c6f-2644-49bb-aa7b-7376fe4a0d5e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.640623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.641689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.642201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.642699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.643798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:51.644425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.646150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.667069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 296/597] 10.222.0.93 () {56 vars in 1139 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:51.667326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd4bd3-3c26-4fde-9922-234a332f72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.668065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4bd3-3c26-4fde-9922-234a332f72a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.668345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4bd3-3c26-4fde-9922-234a332f72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.668622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4bd3-3c26-4fde-9922-234a332f72a5 None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/3ad56212b530461cb19f1bb2b4b14027/roles/7647001353b54c2789f738144d1189c7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.669355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.691390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd4bd3-3c26-4fde-9922-234a332f72a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=3ad56212b530461cb19f1bb2b4b14027, role_id=7647001353b54c2789f738144d1189c7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.692984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd4bd3-3c26-4fde-9922-234a332f72a5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.753135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 302/598] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:51 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/3ad56212b530461cb19f1bb2b4b14027/roles/7647001353b54c2789f738144d1189c7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:51.754119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd4bd3-3c26-4fde-9922-234a332f72a5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.792233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b11ede-ef9a-412f-901a-dcb42bbfb238 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.817819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.824316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.841881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.843363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.843853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.844661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.845629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:51.846151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.847829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.864177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 297/599] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:51.871431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.988227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd4bd3-3c26-4fde-9922-234a332f72a5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.076357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.077053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.077451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.077732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.095922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.097625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:52.121165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:52.122131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:52.123054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:52.123054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:52.123054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:52.123054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:52.123054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 303/600] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:52.128676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:52.166089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc65f86-40ae-4ed0-afac-bfa380bd361c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.224405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.226045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.226327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.226597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.239519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.244296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:52.260225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:52.261212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:52.262125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 298/601] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:52.268404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:52.277235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:52.315813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:52.330821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631c517-f62b-426f-8e22-c3350fb4171e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.385683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f361e87-1406-4249-8b43-9529224405a7 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.425485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.426210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.426487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.426801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.427557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:52.427858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.432397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.448771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 299/602] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:52.454547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:52.455011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.455655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.455930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.456201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.456910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:52.457221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.458608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.496894 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 304/603] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:52.501877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:52.573006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:52.579138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c56dd9-4eba-4fee-8ad4-0204984a2641 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.646773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3c5ff-10f0-45a3-b31b-66ac1c35f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.648242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3c5ff-10f0-45a3-b31b-66ac1c35f272 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.648620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3c5ff-10f0-45a3-b31b-66ac1c35f272 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.648907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3c5ff-10f0-45a3-b31b-66ac1c35f272 None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/3771fe71ef624fd38dcaf2bff3751663/roles/7647001353b54c2789f738144d1189c7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.684262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9444ed-1793-4191-bb3c-7fb554ef633a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.690276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3c5ff-10f0-45a3-b31b-66ac1c35f272 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=3771fe71ef624fd38dcaf2bff3751663, role_id=7647001353b54c2789f738144d1189c7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.691746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3c5ff-10f0-45a3-b31b-66ac1c35f272 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.722166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.722847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.723127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.723401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.732325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.733900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:52.753561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:52.754662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:52.755759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 305/604] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:52.757081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:52.761064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:52.822159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 300/605] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:52 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/3771fe71ef624fd38dcaf2bff3751663/roles/7647001353b54c2789f738144d1189c7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:52.873156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f28435-2dcc-4180-b54a-185f1cfaabf0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.911093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91844b70-fc26-4b97-9268-2fbb3a271359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.911776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91844b70-fc26-4b97-9268-2fbb3a271359 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.912055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91844b70-fc26-4b97-9268-2fbb3a271359 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.912323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91844b70-fc26-4b97-9268-2fbb3a271359 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.913954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91844b70-fc26-4b97-9268-2fbb3a271359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:52.914427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91844b70-fc26-4b97-9268-2fbb3a271359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.916169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91844b70-fc26-4b97-9268-2fbb3a271359 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.931927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 306/606] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:52.938047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3c5ff-10f0-45a3-b31b-66ac1c35f272 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:53.099038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3c5ff-10f0-45a3-b31b-66ac1c35f272 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:53.141523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbacdc-b23e-4267-869f-12a0d13e91d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:53.142199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbacdc-b23e-4267-869f-12a0d13e91d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.142476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbacdc-b23e-4267-869f-12a0d13e91d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.142746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbacdc-b23e-4267-869f-12a0d13e91d0 None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/a67b35a2567941f59dd746a3813b9d7a/roles/7647001353b54c2789f738144d1189c7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.159599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbacdc-b23e-4267-869f-12a0d13e91d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=a67b35a2567941f59dd746a3813b9d7a, role_id=7647001353b54c2789f738144d1189c7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:53.161202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbacdc-b23e-4267-869f-12a0d13e91d0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:53.177041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa41c7-0680-4362-957a-33016816edf7 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.177640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa41c7-0680-4362-957a-33016816edf7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.178121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa41c7-0680-4362-957a-33016816edf7 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.180990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 307/607] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:04:53.186406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696d05e-ea37-4209-a254-26421cabd1b3 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.186694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696d05e-ea37-4209-a254-26421cabd1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.186974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696d05e-ea37-4209-a254-26421cabd1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.206667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3696d05e-ea37-4209-a254-26421cabd1b3 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:53.207913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3696d05e-ea37-4209-a254-26421cabd1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:53.235078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:53.244591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 301/608] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:52 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/a67b35a2567941f59dd746a3813b9d7a/roles/7647001353b54c2789f738144d1189c7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:53.269595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925a0c-0d0e-488f-9312-e86a55a83849 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.269915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925a0c-0d0e-488f-9312-e86a55a83849 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.270139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925a0c-0d0e-488f-9312-e86a55a83849 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.271960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 302/609] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:04:53.277853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf334c-018f-48a3-8923-065146ed9226 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.278469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf334c-018f-48a3-8923-065146ed9226 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.278942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf334c-018f-48a3-8923-065146ed9226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.285749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:53.295049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 308/610] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:04:53.317576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-33bf334c-018f-48a3-8923-065146ed9226 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:53.319679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-33bf334c-018f-48a3-8923-065146ed9226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:53.322209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696d05e-ea37-4209-a254-26421cabd1b3 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:53.442981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 303/611] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:53.469924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf334c-018f-48a3-8923-065146ed9226 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:53.488737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696d05e-ea37-4209-a254-26421cabd1b3 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:53.531217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e7dc-167b-4698-8475-54cbe06cb1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:53.531869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e7dc-167b-4698-8475-54cbe06cb1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.532150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e7dc-167b-4698-8475-54cbe06cb1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.532430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e7dc-167b-4698-8475-54cbe06cb1b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.544979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9e7dc-167b-4698-8475-54cbe06cb1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-f2a9e7dc-167b-4698-8475-54cbe06cb1b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:53.550246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:53.551165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:53.552118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 309/612] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:53.562292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e7dc-167b-4698-8475-54cbe06cb1b1 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:53.631251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:53.684769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e7dc-167b-4698-8475-54cbe06cb1b1 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:53.747720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf334c-018f-48a3-8923-065146ed9226 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:53.752925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:53.754754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.755315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.755816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.757572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:53.758158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:53.760321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:53.770742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 310/613] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:53.782080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:53.794122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:53.814158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa4bfe-112d-4090-bdcf-68bfd5efb88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:53.814928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa4bfe-112d-4090-bdcf-68bfd5efb88d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.815137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa4bfe-112d-4090-bdcf-68bfd5efb88d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.815449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa4bfe-112d-4090-bdcf-68bfd5efb88d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.841016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa4bfe-112d-4090-bdcf-68bfd5efb88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-18fa4bfe-112d-4090-bdcf-68bfd5efb88d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:53.854140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:53.855147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:53.856408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 304/614] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:53.865849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa4bfe-112d-4090-bdcf-68bfd5efb88d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:53.897671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a97dc4-2723-4d3b-b828-bd3281e63f7c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:53.916795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:53.935750 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:53.936777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:53.937287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:53.937782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:53.950469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:53.952326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:53.991920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:53.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:53.994457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:53.994457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:53.994457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:53.994457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:53.994457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 311/615] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:53.998864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:54.035441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa4bfe-112d-4090-bdcf-68bfd5efb88d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:54.103249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:54.103873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.104145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.104411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.105146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:54.105442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:54.106797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:54.129726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 305/616] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:54.133078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:54.212682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce0511-3ce5-45e4-bb6d-2bdb4de214d1 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:54.233315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:54.277546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:54.278350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.278828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.279203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.281141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:54.282070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:54.284543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:54.301950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 312/617] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:54.307716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:54.310578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275f9ab-942d-4d8e-9113-e69fef621894 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:54.364463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:54.365145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.365429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.365701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.378417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:54.380485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:54.382773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:54.410934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:54.411887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:54.413083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:54.413083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:54.413083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:54.413083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:54.416926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 306/618] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:04:54.418694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:54.531993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd381-6e9d-40d0-9214-77f1cd7da6ca None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:54.586083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5311-7920-4050-87ec-f723395ef5fd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:54.587958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:54.590377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d67a5f-5c4a-4a00-827d-be0f958e653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:54.591103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67a5f-5c4a-4a00-827d-be0f958e653e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.591450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67a5f-5c4a-4a00-827d-be0f958e653e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.591785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67a5f-5c4a-4a00-827d-be0f958e653e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.601848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d67a5f-5c4a-4a00-827d-be0f958e653e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:54.604225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d67a5f-5c4a-4a00-827d-be0f958e653e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-c7d67a5f-5c4a-4a00-827d-be0f958e653e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:54.620204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:54.621238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:54.624143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 313/619] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:04:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:54.625580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1e07-22d1-4317-b0f2-cd1ff654874b None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.625580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1e07-22d1-4317-b0f2-cd1ff654874b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.625580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1e07-22d1-4317-b0f2-cd1ff654874b None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.628933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 314/620] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:54.630045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de1e07-22d1-4317-b0f2-cd1ff654874b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:54.635754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001d83f-45c1-47f1-b05b-d3ed676f300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:54.636381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d83f-45c1-47f1-b05b-d3ed676f300f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.636663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d83f-45c1-47f1-b05b-d3ed676f300f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.636966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d83f-45c1-47f1-b05b-d3ed676f300f None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.637713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001d83f-45c1-47f1-b05b-d3ed676f300f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:54.638020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001d83f-45c1-47f1-b05b-d3ed676f300f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:54.639387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001d83f-45c1-47f1-b05b-d3ed676f300f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:54.654128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 307/621] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:54.655517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cb92-22f7-4548-abd6-ef4ed84a7095 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.655699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cb92-22f7-4548-abd6-ef4ed84a7095 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.655960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cb92-22f7-4548-abd6-ef4ed84a7095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.675306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9b74cb92-22f7-4548-abd6-ef4ed84a7095 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:54.676484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9b74cb92-22f7-4548-abd6-ef4ed84a7095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:54.750887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:54.763159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 308/622] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:54.769178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74cb92-22f7-4548-abd6-ef4ed84a7095 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:54.779462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de1e07-22d1-4317-b0f2-cd1ff654874b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:54.828162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:54.828731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.829098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.829378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.830240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:54.830547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:54.832013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:54.886151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 315/623] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Aug 4 21:04:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:54.886951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:54.905551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:54.918732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74cb92-22f7-4548-abd6-ef4ed84a7095 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:54.967566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:54.968510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:54.968992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:54.969438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:54.980911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:54.983259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:54.999523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d883a7e-1953-48a5-861b-7750dea48165 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:55.000655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:55.001617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:04:55.002555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:55.010990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 309/624] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:04:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:55.011287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.056719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5683-d810-410f-b6ca-334090dc7d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.057811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5683-d810-410f-b6ca-334090dc7d3f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.058299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5683-d810-410f-b6ca-334090dc7d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.059229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc5683-d810-410f-b6ca-334090dc7d3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.075449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc5683-d810-410f-b6ca-334090dc7d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-15bc5683-d810-410f-b6ca-334090dc7d3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:55.083374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:55.084298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:55.086081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:55.093711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 316/625] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:55.094123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5683-d810-410f-b6ca-334090dc7d3f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.105724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.132340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710b17-9c6a-4a7e-83fe-8142ddae7a98 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.172561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.173293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.173574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.173933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.186676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.188191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:55.205062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:55.206036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:55.206934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:55.206934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:55.206934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:55.206934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:55.211945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 310/626] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:55.212872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.216927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.229339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc5683-d810-410f-b6ca-334090dc7d3f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.282491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.284219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.284686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.285173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.286751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:55.287251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.289753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.316502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 317/627] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:55.316502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.337257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3871af-9ac8-413a-a6f5-7c1befdaf8ac None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.374828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143200de-65ed-40d2-b3f3-4748f8455f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.375444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143200de-65ed-40d2-b3f3-4748f8455f2c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.375719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143200de-65ed-40d2-b3f3-4748f8455f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.375988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143200de-65ed-40d2-b3f3-4748f8455f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.376689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143200de-65ed-40d2-b3f3-4748f8455f2c None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:55.377015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143200de-65ed-40d2-b3f3-4748f8455f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.378365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143200de-65ed-40d2-b3f3-4748f8455f2c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.385427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.388801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 311/628] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:55.390818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370a41-f57e-4567-9ea7-0296957f3793 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.391111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370a41-f57e-4567-9ea7-0296957f3793 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.391388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370a41-f57e-4567-9ea7-0296957f3793 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.393301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 312/629] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:55.394191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b370a41-f57e-4567-9ea7-0296957f3793 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.430048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4caae3-12b8-468b-a1ec-92f73f001e70 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.469339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.470804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.471410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.471862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.472126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.472820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:55.473159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.474583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.489632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 318/630] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:55.490903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.513582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b370a41-f57e-4567-9ea7-0296957f3793 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.548664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9498e-436f-45bc-9568-f96b808973b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.549320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9498e-436f-45bc-9568-f96b808973b8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.549568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9498e-436f-45bc-9568-f96b808973b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.549830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9498e-436f-45bc-9568-f96b808973b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.598199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c18b7-19ff-4233-8928-9f1a71e63d73 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.619088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9498e-436f-45bc-9568-f96b808973b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.620566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9498e-436f-45bc-9568-f96b808973b8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.622968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.633947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c76f7-79e8-46af-8432-0bd66a49b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.650721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c76f7-79e8-46af-8432-0bd66a49b9ea None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.650721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c76f7-79e8-46af-8432-0bd66a49b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.650721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c76f7-79e8-46af-8432-0bd66a49b9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.650721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c76f7-79e8-46af-8432-0bd66a49b9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.650721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c76f7-79e8-46af-8432-0bd66a49b9ea None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-8d5c76f7-79e8-46af-8432-0bd66a49b9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:55.662520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:55.663619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:55.664535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:55.664535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:55.664535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:55.664535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:55.664535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 319/631] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:55.665912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b39609-c0c4-43a8-b5b3-378fcba6fed4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.666197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b39609-c0c4-43a8-b5b3-378fcba6fed4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.666468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b39609-c0c4-43a8-b5b3-378fcba6fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.685152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-54b39609-c0c4-43a8-b5b3-378fcba6fed4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:55.686365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-54b39609-c0c4-43a8-b5b3-378fcba6fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.690855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.727274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 313/632] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:55.728124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9498e-436f-45bc-9568-f96b808973b8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.755740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 320/633] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:55.757836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4545016-b40f-419f-88af-fb67fd4bce4e None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.758117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4545016-b40f-419f-88af-fb67fd4bce4e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.758398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4545016-b40f-419f-88af-fb67fd4bce4e None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.759891 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 321/634] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:55.760594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4545016-b40f-419f-88af-fb67fd4bce4e None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.833102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9498e-436f-45bc-9568-f96b808973b8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.868610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.869247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.869524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.869791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.875419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4545016-b40f-419f-88af-fb67fd4bce4e None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.877244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.878679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.883747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:55.890421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:55.894561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 314/635] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:55.895490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.915657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fad42-fbe5-40a9-b07e-5f29f285ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.916280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fad42-fbe5-40a9-b07e-5f29f285ccff None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.916556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fad42-fbe5-40a9-b07e-5f29f285ccff None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.916823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fad42-fbe5-40a9-b07e-5f29f285ccff None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.917793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fad42-fbe5-40a9-b07e-5f29f285ccff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:55.918096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fad42-fbe5-40a9-b07e-5f29f285ccff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.919494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fad42-fbe5-40a9-b07e-5f29f285ccff None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.923519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.932838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 322/636] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:55.935656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2b18-fe21-4c4f-86f6-b66cd2a6dd7e None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.935656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2b18-fe21-4c4f-86f6-b66cd2a6dd7e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.935656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2b18-fe21-4c4f-86f6-b66cd2a6dd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.952008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-838c2b18-fe21-4c4f-86f6-b66cd2a6dd7e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:55.953256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-838c2b18-fe21-4c4f-86f6-b66cd2a6dd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.999372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcee02-caea-4b16-90dd-bace8042b6a8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.025346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 323/637] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:56.026392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c2b18-fe21-4c4f-86f6-b66cd2a6dd7e None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.035617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.036282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.036587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.036861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.048234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.049706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:56.064341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:56.065551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:56.066443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:56.066443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:56.066443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:56.066443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:56.066443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 315/638] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:56.066443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.125337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.131227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c2b18-fe21-4c4f-86f6-b66cd2a6dd7e None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.144685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.166859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bcc0d-212c-49fa-8c1e-3f73faf559c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.167810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bcc0d-212c-49fa-8c1e-3f73faf559c6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.168011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4caf3b-171c-4697-b45f-6737f7f26dbc None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.168112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bcc0d-212c-49fa-8c1e-3f73faf559c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.168455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bcc0d-212c-49fa-8c1e-3f73faf559c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.178424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bcc0d-212c-49fa-8c1e-3f73faf559c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-6c4bcc0d-212c-49fa-8c1e-3f73faf559c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:56.183695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:56.184787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 324/639] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:56.190701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bcc0d-212c-49fa-8c1e-3f73faf559c6 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.203114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.203773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.204048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.204317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.205089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:56.205411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.206837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.221087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 316/640] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:56.221916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.291374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bcc0d-212c-49fa-8c1e-3f73faf559c6 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.324286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180f82-bbdc-422e-b9cc-5f8675d719cd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.327158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.328437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.328437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.328437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.337150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.339505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:56.351798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:56.352858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 325/641] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:56.354266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.363547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ea8c4-ebfa-48cf-b41e-c65ba13c46b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.364183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ea8c4-ebfa-48cf-b41e-c65ba13c46b3 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.364461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ea8c4-ebfa-48cf-b41e-c65ba13c46b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.364735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ea8c4-ebfa-48cf-b41e-c65ba13c46b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.372832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.373115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.376836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ea8c4-ebfa-48cf-b41e-c65ba13c46b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-937ea8c4-ebfa-48cf-b41e-c65ba13c46b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:56.382087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:56.389239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 317/642] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:56.390281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ea8c4-ebfa-48cf-b41e-c65ba13c46b3 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.457313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8c30-b3a3-4349-a1fe-536425b46d07 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.492828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.493478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.493778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.494043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.494616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ea8c4-ebfa-48cf-b41e-c65ba13c46b3 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.494730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:56.495014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.496365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.508551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 326/643] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:56.509514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.532640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.533279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.533555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.533825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.534518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:56.534814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.536161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.544948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 318/644] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:56.545722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.587603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.607139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.612297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4739-2cf6-4d27-be7b-5567c8c8eacf None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.648672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d2ff-0cc2-44d7-8227-2a19c34b560d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.650632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c309a-8c1f-40d9-89c5-71bd04db4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.651487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309a-8c1f-40d9-89c5-71bd04db4ffb None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.652040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309a-8c1f-40d9-89c5-71bd04db4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.652397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309a-8c1f-40d9-89c5-71bd04db4ffb None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/348efd4e6a0948afb8b0015d9bfb1d08/roles/7647001353b54c2789f738144d1189c7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.669376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c309a-8c1f-40d9-89c5-71bd04db4ffb None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=348efd4e6a0948afb8b0015d9bfb1d08, role_id=7647001353b54c2789f738144d1189c7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.670831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c309a-8c1f-40d9-89c5-71bd04db4ffb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.686516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.690034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.690034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.690034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.690034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:56.690034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.690605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.707333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 319/645] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:56.708216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.745042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 327/646] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:04:56 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/348efd4e6a0948afb8b0015d9bfb1d08/roles/7647001353b54c2789f738144d1189c7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:56.746005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c309a-8c1f-40d9-89c5-71bd04db4ffb None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.829404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cc498-3914-4ead-8a17-3ff3896e50ee None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.849759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.868506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.869110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.869387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.869655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.870376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:56.870674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.872186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.886301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 320/647] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:56.886505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c309a-8c1f-40d9-89c5-71bd04db4ffb None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.886602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.920238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.931059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.931734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.932013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.932280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.939215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.940698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:56.953448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:56.954376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:56.955250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:56.955250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:56.955250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:56.955250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:56.955250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:56.955250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:56.955250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:56.955250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:56.957610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 328/648] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:56.958370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.010721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754799a2-1a89-4356-90e9-b4e3f9225b03 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.049262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.050217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.050813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.051652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.066401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.067836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.072095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318ffe5-84f2-4c37-8c66-a32f59ca8a05 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:57.083503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:57.084417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:57.085596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:57.085596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:57.085596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:57.085596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:57.085596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 321/649] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:57.085596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.115347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b29a97-f8e2-446d-a56f-38160d111dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.117038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29a97-f8e2-446d-a56f-38160d111dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.117472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29a97-f8e2-446d-a56f-38160d111dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.117930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29a97-f8e2-446d-a56f-38160d111dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.122832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.184798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.197541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b29a97-f8e2-446d-a56f-38160d111dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.198999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b29a97-f8e2-446d-a56f-38160d111dc2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.200232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b95c7-b84d-4603-8d7c-15500cf51c60 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.238649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.239296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.239575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.239847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.251353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.252799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:57.268028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:57.269028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:57.269947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:57.269947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:57.269947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:57.269947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:57.269947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 322/650] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:57.270736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.313698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 329/651] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:57.315392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b29a97-f8e2-446d-a56f-38160d111dc2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.363440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.381513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997806e-1d50-4665-8ff9-458224864730 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.410154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.419890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.420513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.420791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.421095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.421838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:57.426513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.426513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.426757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b29a97-f8e2-446d-a56f-38160d111dc2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.436243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 323/652] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:57.437089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.470551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.471521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.471974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.472393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.473257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:57.473726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.476068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.490601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 330/653] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:57.490601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.558239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1032ee-ed63-415f-bb0c-994ff133b26a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.593242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.593854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.594139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.594414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.595096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:57.595429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.597029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.607469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b39dc4-1b26-4deb-876a-5b3e69248af4 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.611770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 324/654] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:57.612761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.620838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.643199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.643979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.644318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.644653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.657555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.659071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.666894 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:57.676208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:57.682972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:57.684094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:57.684094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:57.684094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:57.684094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:57.684094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 331/655] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:57.684094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.737709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6b2a4-a692-4c63-b645-71e36b58a53a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.774821 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.775597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.775881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.776297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.777112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=66a82e8f2e304418adce1935fe7abcb8) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:57.777425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.778994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.793086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd71afb-1666-44ad-87b6-2f660dd7a346 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.793292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 325/656] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/role_assignments?user.id=66a82e8f2e304418adce1935fe7abcb8&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:57.793292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.841780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.842496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.842778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.843056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.856035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.857912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:57.873417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:57.874483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:57.875593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 332/657] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:57.876259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.884546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.932752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5ae16-137d-4fce-b298-93596324ebdc None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.949640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.980970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.981634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.981975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.982250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.992530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.994327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.005277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9c40a-e831-4303-bc1d-d3c57bac1d99 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:04:58.010820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:58.011797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 21:04:58.012739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:58.015046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 326/658] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:58.019857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.048374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.049066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.049351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.049627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.050319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:58.050623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.052040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.070011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 333/659] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:58.071743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.151199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af161d5-3ddc-4390-8168-64d0cda19ae1 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.187930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:58.199667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.200116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b0706-ce8b-4adb-8be4-3e59254b1eaa None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.200316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.200563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.200833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.201699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:58.202244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.204649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.220791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:58.230622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 327/660] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:58.231578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.248282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.248836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.249162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.249438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.250232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:58.250534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.252034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.277116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 334/661] 10.222.0.93 () {56 vars in 1139 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:58.277922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.366527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c387-804f-4825-afa6-447e8bf8aaa0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.409031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.409782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.409957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.410206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.411268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f5a28-7e9d-4b96-bdf0-5c715291009d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.419547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.421612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:58.439591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:58.441722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:58.443777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:58.443777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:58.443777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:58.443777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:58.443777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:58.443777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:58.443777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:58.443777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:58.445596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 328/662] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:58.450055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.457140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac795aa-02d8-4286-912c-7472f7afedbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.457765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac795aa-02d8-4286-912c-7472f7afedbc None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.458042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac795aa-02d8-4286-912c-7472f7afedbc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.458310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac795aa-02d8-4286-912c-7472f7afedbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.513321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:58.518387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:58.542723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac795aa-02d8-4286-912c-7472f7afedbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.544201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac795aa-02d8-4286-912c-7472f7afedbc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.582024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231ff5d-c2ca-487a-bce0-ac1437468463 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.629403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf4b9-f66d-49e9-9223-fb1c58250af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.630127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf4b9-f66d-49e9-9223-fb1c58250af0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.630402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf4b9-f66d-49e9-9223-fb1c58250af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.630783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf4b9-f66d-49e9-9223-fb1c58250af0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.671913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 335/663] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:58.673190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac795aa-02d8-4286-912c-7472f7afedbc None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.713137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf4b9-f66d-49e9-9223-fb1c58250af0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.715260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf4b9-f66d-49e9-9223-fb1c58250af0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.762474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:58.765322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:58.790628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac795aa-02d8-4286-912c-7472f7afedbc None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.825855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 329/664] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:04:58.826902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf4b9-f66d-49e9-9223-fb1c58250af0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.830187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.831329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.832819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.833289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.834175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:58.835267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.837411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.851232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 336/665] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:58.852467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.937686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf4b9-f66d-49e9-9223-fb1c58250af0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.967599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf810c5-43f8-4297-96ee-d4022d7aa8db None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.978607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe510-dea0-488c-8933-eedd5e332506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.979568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe510-dea0-488c-8933-eedd5e332506 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.979854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe510-dea0-488c-8933-eedd5e332506 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.980293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe510-dea0-488c-8933-eedd5e332506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.992048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbe510-dea0-488c-8933-eedd5e332506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.993709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbe510-dea0-488c-8933-eedd5e332506 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.002040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.006146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.006845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.007128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.007403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.011526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-14cbe510-dea0-488c-8933-eedd5e332506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:59.012092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:59.013054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:59.014070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:59.014070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:59.014070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:59.014070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:59.017758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 330/666] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:59.019007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982d18-2e9e-4783-8f6a-144679d094d2 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.019292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982d18-2e9e-4783-8f6a-144679d094d2 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.020768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982d18-2e9e-4783-8f6a-144679d094d2 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.025075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.025209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 331/667] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:04:59.025209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23982d18-2e9e-4783-8f6a-144679d094d2 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.025371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:04:59.041926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:59.043585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:59.044509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:04:59.044509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:04:59.044509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:04:59.044509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:59.045335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 337/668] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:59.045658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.146137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23982d18-2e9e-4783-8f6a-144679d094d2 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.157260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b5a2e-4870-4fdb-8bb1-3c39300b0bf9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.185193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae29a02-fe5b-490e-adf7-aa1b156bb2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.185816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29a02-fe5b-490e-adf7-aa1b156bb2ce None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.186094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29a02-fe5b-490e-adf7-aa1b156bb2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.186365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29a02-fe5b-490e-adf7-aa1b156bb2ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.187267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae29a02-fe5b-490e-adf7-aa1b156bb2ce None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=3ad56212b530461cb19f1bb2b4b14027) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:59.187575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae29a02-fe5b-490e-adf7-aa1b156bb2ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.189225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae29a02-fe5b-490e-adf7-aa1b156bb2ce None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.196082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.196702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.197088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.197503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.198077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:59.198382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.199763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.208220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 332/669] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/role_assignments?user.id=3ad56212b530461cb19f1bb2b4b14027&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:59.210742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa474d-4bb0-4886-a883-caf026832ab8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.211038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa474d-4bb0-4886-a883-caf026832ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.211436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa474d-4bb0-4886-a883-caf026832ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.217593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 338/670] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:59.218910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.239869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-41aa474d-4bb0-4886-a883-caf026832ab8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:59.241233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-41aa474d-4bb0-4886-a883-caf026832ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:59.284308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.310201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.324015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 333/671] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:04:59.325305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa474d-4bb0-4886-a883-caf026832ab8 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.342817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dbf2b-eaa8-4699-9c34-a7b706ee4996 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.383707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.384344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.384626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.384910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.385700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:59.386009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.387400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.402903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 339/672] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:59.403764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.446589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa474d-4bb0-4886-a883-caf026832ab8 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.493279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.494288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.494718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.495166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.504289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.505842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:59.521431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:59.522679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:59.523581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:59.523581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:59.523581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:59.523581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:59.523581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:59.523581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:59.523581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:59.523581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:59.527595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 334/673] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:59.528538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.545002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af3ce-df62-41b5-b3c0-8f1f1afbf883 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.556527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.591564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.593165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8415c9-1571-4bdd-921b-fe424f354924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.593820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8415c9-1571-4bdd-921b-fe424f354924 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.594261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8415c9-1571-4bdd-921b-fe424f354924 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.594685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8415c9-1571-4bdd-921b-fe424f354924 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.610035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8415c9-1571-4bdd-921b-fe424f354924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-4e8415c9-1571-4bdd-921b-fe424f354924 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:04:59.617282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:59.618306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:04:59.619232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 340/674] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:59.620433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8415c9-1571-4bdd-921b-fe424f354924 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.651409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53488c0e-9c77-44f9-9512-40ee3b9fa72f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.693305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.694415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.694889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.695484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.705293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.707128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:04:59.722248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:04:59.723202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:04:59.724110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 335/675] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:04:59.724610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.747661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8415c9-1571-4bdd-921b-fe424f354924 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.785450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.786525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.787014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.788173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.789518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:59.790050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.791692 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.811709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 341/676] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:59.813171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.850433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3c0d-5881-4172-8a24-ed57c2447b66 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.852705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.868025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.897826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.898496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.898784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.899033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.899754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:59.900052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.901468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.912430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 336/677] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:59.914132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.934946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599ad1-28ca-4a03-9061-5219b08c2ac8 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.980736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.981785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.982469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.982982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.984412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:59.985018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.987370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.004492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 342/678] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:00.005974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.041251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5182c-f668-4e1a-b54f-ec3921c7e9e5 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.076662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.077228 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.077498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.077931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.078596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=3771fe71ef624fd38dcaf2bff3751663) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:00.078842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.080267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.087778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 337/679] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/role_assignments?user.id=3771fe71ef624fd38dcaf2bff3751663&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:00.088609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.133231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:00.136072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:00.153994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38845bc-6c6c-442c-ad8d-4f8d5a9fb85a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.205479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fc41f-ce95-4072-95f3-2ad2144181b1 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.207745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645a117-e2d1-4b05-82fb-4763dacb49c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.210324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645a117-e2d1-4b05-82fb-4763dacb49c1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.210859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645a117-e2d1-4b05-82fb-4763dacb49c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.211515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645a117-e2d1-4b05-82fb-4763dacb49c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.228047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645a117-e2d1-4b05-82fb-4763dacb49c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.230554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645a117-e2d1-4b05-82fb-4763dacb49c1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.246830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.247580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.247927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.248264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.249151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=a67b35a2567941f59dd746a3813b9d7a) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:00.249524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.251027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-7645a117-e2d1-4b05-82fb-4763dacb49c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:00.252051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:00.252972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:00.253948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:00.253948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:00.253948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:00.253948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:00.261342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 343/680] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:00.262713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca9aa-ef80-4296-93cc-24e5aa5bbe2c None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.263004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca9aa-ef80-4296-93cc-24e5aa5bbe2c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.263406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 338/681] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/role_assignments?user.id=a67b35a2567941f59dd746a3813b9d7a&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:00.263533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca9aa-ef80-4296-93cc-24e5aa5bbe2c None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.264153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.264914 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 344/682] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:00.277245 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1592-ac6c-4ad1-9078-d0c10a6e4fae None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.277531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1592-ac6c-4ad1-9078-d0c10a6e4fae None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.277811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1592-ac6c-4ad1-9078-d0c10a6e4fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.307172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-57cc1592-ac6c-4ad1-9078-d0c10a6e4fae None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:00.308856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-57cc1592-ac6c-4ad1-9078-d0c10a6e4fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:00.397031 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 345/683] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:05:00.427265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc1592-ac6c-4ad1-9078-d0c10a6e4fae None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.434880 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2b942-b562-455c-b5fe-70ceb95cbe29 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.437938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:00.484458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.486428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.486892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.487435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.488589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:00.489066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.491725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.507749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 339/684] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:00.512498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.557031 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:00.604098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc1592-ac6c-4ad1-9078-d0c10a6e4fae None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.650668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5d632-df47-447d-9db6-0b0eae2d1414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.651246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d632-df47-447d-9db6-0b0eae2d1414 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.651527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d632-df47-447d-9db6-0b0eae2d1414 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.651799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d632-df47-447d-9db6-0b0eae2d1414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.664431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5088a02-7171-4c43-a2ef-e5dfde58f834 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.668993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5d632-df47-447d-9db6-0b0eae2d1414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-ceb5d632-df47-447d-9db6-0b0eae2d1414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:00.676412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:00.677414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:00.678295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 346/685] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:00.685322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5d632-df47-447d-9db6-0b0eae2d1414 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.727246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.728261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.728767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.729260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.744679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.747474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:00.772178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:00.773224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:05:00.774214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:00.782560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 340/686] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:00.788247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.838942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5d632-df47-447d-9db6-0b0eae2d1414 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.860099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:00.881802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:00.900804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.901793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.902321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.902792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.903713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:00.904280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.905935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.919919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 347/687] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:00.926598 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.014659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806a27-d9e9-45ee-89f5-8637d44c4657 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.082472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.083501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.083977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.085245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.086307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:01.087020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.089731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.121333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbd5d9-db8f-4a51-9d7d-894f778c2de7 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.123622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 341/688] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:01.133823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.188203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.189253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.189767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.190272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.212195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.214023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:01.240027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:01.241537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:01.242422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:01.242422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:01.242422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:01.242422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:01.246583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 348/689] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:01.252850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.287897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:01.307287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:01.332505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72e1fc-6440-4870-a427-bbbae65b0248 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.373206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef6d3-dd03-41ed-867f-41308828ecc4 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.414486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.416050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.416538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.417078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.417880 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b11757-9c9d-44f0-8bb9-e991b4d4d02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.418517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11757-9c9d-44f0-8bb9-e991b4d4d02d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.418754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:01.418855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11757-9c9d-44f0-8bb9-e991b4d4d02d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.419053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11757-9c9d-44f0-8bb9-e991b4d4d02d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.419531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.421326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.437236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 349/690] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:01.447588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.515181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b11757-9c9d-44f0-8bb9-e991b4d4d02d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.516666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b11757-9c9d-44f0-8bb9-e991b4d4d02d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.608114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:01.628745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 342/691] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:01.635151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761c220-a52e-4af7-992a-ba7f6f9ad0cf None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.635440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761c220-a52e-4af7-992a-ba7f6f9ad0cf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.635717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761c220-a52e-4af7-992a-ba7f6f9ad0cf None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.637172 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 343/692] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:01.640928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761c220-a52e-4af7-992a-ba7f6f9ad0cf None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.646632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716b85b-7ba5-4eff-9a38-afae0cea3b83 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.650587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:01.687099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8990a-0f79-4f31-a664-3110311bf78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.688218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8990a-0f79-4f31-a664-3110311bf78a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.688819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8990a-0f79-4f31-a664-3110311bf78a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.689299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8990a-0f79-4f31-a664-3110311bf78a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.698280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8990a-0f79-4f31-a664-3110311bf78a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.700158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8990a-0f79-4f31-a664-3110311bf78a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-afc8990a-0f79-4f31-a664-3110311bf78a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:01.714878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:01.715871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:01.716832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:01.719263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 350/693] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:01.726244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c9b2-9e19-4544-a1c5-30c1b83fa48c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.726898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c9b2-9e19-4544-a1c5-30c1b83fa48c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.727670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c9b2-9e19-4544-a1c5-30c1b83fa48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.747145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-6e79c9b2-9e19-4544-a1c5-30c1b83fa48c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:01.749146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6e79c9b2-9e19-4544-a1c5-30c1b83fa48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:01.754549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761c220-a52e-4af7-992a-ba7f6f9ad0cf None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.794170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.794954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.795460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.795797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.807494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.809165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.826079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 351/694] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:05:01.827265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c9b2-9e19-4544-a1c5-30c1b83fa48c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:01.833035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:01.833924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:01.835499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:01.835499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:01.835499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:01.835499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:01.835499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 344/695] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:01.841594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.885567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:01.945254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:01.953669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c9b2-9e19-4544-a1c5-30c1b83fa48c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.972798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f63a5-df4b-436c-a030-c0869ee889c1 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.994784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.995800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.996287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.996752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.997759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:01.998257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.999898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.015957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.016597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.017147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.017425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.018115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:02.018423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.019841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.020268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 352/696] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:02.021315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.034059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 345/697] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:02.035225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.134530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a4231-d4c9-48af-b10a-b993131f31f8 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.157309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:02.165593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc75481-27aa-4bf0-8349-806cf60dab96 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.174776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.175676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.181328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.181328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.189445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.191176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.205946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7057463-71d6-4f71-9462-1f42808b5488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.206490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057463-71d6-4f71-9462-1f42808b5488 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.206768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057463-71d6-4f71-9462-1f42808b5488 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.207039 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7057463-71d6-4f71-9462-1f42808b5488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:02.209890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:02.210982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:02.211873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:02.211873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:02.211873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:02.211873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:02.214068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 353/698] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:02.215127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.219106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:02.284198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7057463-71d6-4f71-9462-1f42808b5488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.285902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7057463-71d6-4f71-9462-1f42808b5488 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.326754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53978-1bb3-4b98-83fd-ea8d4779c7d2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.366464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.367501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.367941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.368370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.376157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.377896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.379585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:02.393183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:02.394111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:02.394987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:02.394987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:02.394987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:02.394987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:02.394987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:02.394987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:02.394987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:02.394987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:02.395408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 346/699] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:02.395408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7057463-71d6-4f71-9462-1f42808b5488 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.398297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 354/700] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:02.399306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.472102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:02.511223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7057463-71d6-4f71-9462-1f42808b5488 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.525718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b596-1f9f-4650-be3e-9709a75d3f32 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.556370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.557271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.557384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.557659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.558293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:02.558596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.560007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.565823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edafbf8-3a09-414e-9240-6ef80c53218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.566468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edafbf8-3a09-414e-9240-6ef80c53218d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.566743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edafbf8-3a09-414e-9240-6ef80c53218d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.567565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edafbf8-3a09-414e-9240-6ef80c53218d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.573296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 347/701] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:02.574421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.582601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edafbf8-3a09-414e-9240-6ef80c53218d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.584482 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edafbf8-3a09-414e-9240-6ef80c53218d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-0edafbf8-3a09-414e-9240-6ef80c53218d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:02.599757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:02.601662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:02.602722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:02.602722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:02.602722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:02.602722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:02.606385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 355/702] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:02.607645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94638d2-c21f-491b-86ab-cdeeea992eef None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.607929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94638d2-c21f-491b-86ab-cdeeea992eef None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.608202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94638d2-c21f-491b-86ab-cdeeea992eef None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.609776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 356/703] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:02.610221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94638d2-c21f-491b-86ab-cdeeea992eef None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.653464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:02.710072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64850-4fa8-41db-ba96-d009133f5a53 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.728997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94638d2-c21f-491b-86ab-cdeeea992eef None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.751241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:02.757382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.758079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.758368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.758649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.759437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:02.764835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.764835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.770722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539e145-6048-41ea-920f-386fc2db9196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.771335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e145-6048-41ea-920f-386fc2db9196 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.771612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e145-6048-41ea-920f-386fc2db9196 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.772428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e145-6048-41ea-920f-386fc2db9196 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.773558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539e145-6048-41ea-920f-386fc2db9196 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.775276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 348/704] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:02.775395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539e145-6048-41ea-920f-386fc2db9196 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.775856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.867448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 357/705] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:05:02 2022] POST /identity/v3/users => generated 254 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:02.868757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307bae1-ad84-45d4-865b-8c2e11947c2b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.869034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307bae1-ad84-45d4-865b-8c2e11947c2b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.869303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307bae1-ad84-45d4-865b-8c2e11947c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.887826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272df5d-1b4d-4a73-8d0d-e5dc53cc1542 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.889077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f307bae1-ad84-45d4-865b-8c2e11947c2b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:02.890496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f307bae1-ad84-45d4-865b-8c2e11947c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:02.906040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:02.935757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.936400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.936753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.937092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.938538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:02.938538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.939756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.960069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 349/706] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:02.960069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.989242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 358/707] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:05:02.989242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0ab4-94dd-49df-a9f9-32af47a032ff None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.989242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0ab4-94dd-49df-a9f9-32af47a032ff None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.989242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0ab4-94dd-49df-a9f9-32af47a032ff None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.989242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 359/708] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:02.989242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca0ab4-94dd-49df-a9f9-32af47a032ff None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.099026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fca011-376d-497e-9b1c-41aaab7515da None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.124420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca0ab4-94dd-49df-a9f9-32af47a032ff None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.126234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:03.151457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ad4d2-93bb-423c-a1bb-ac8ed54b68df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.152087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad4d2-93bb-423c-a1bb-ac8ed54b68df None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.152363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad4d2-93bb-423c-a1bb-ac8ed54b68df None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.152630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad4d2-93bb-423c-a1bb-ac8ed54b68df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.153438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad4d2-93bb-423c-a1bb-ac8ed54b68df None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=348efd4e6a0948afb8b0015d9bfb1d08) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:03.153776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad4d2-93bb-423c-a1bb-ac8ed54b68df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.155243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad4d2-93bb-423c-a1bb-ac8ed54b68df None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.168924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 350/709] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/role_assignments?user.id=348efd4e6a0948afb8b0015d9bfb1d08&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:03.168924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1830-7efa-4bd9-a1d5-76d0fc679444 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.168924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1830-7efa-4bd9-a1d5-76d0fc679444 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.168924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1830-7efa-4bd9-a1d5-76d0fc679444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.182305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.184626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.185114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.185582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.191080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-06bc1830-7efa-4bd9-a1d5-76d0fc679444 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:03.192435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-06bc1830-7efa-4bd9-a1d5-76d0fc679444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:03.205880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.208424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:03.228282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:03.229289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:03.230207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:03.230207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:03.230207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:03.230207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:03.230207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:03.230207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:03.230207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:03.230207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:03.236211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 360/710] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:03.236211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.241065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:03.303715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 351/711] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:05:03.305234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1830-7efa-4bd9-a1d5-76d0fc679444 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.388074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd8fb-9d8b-4e3e-bf06-936e472e2f4d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.449781 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1830-7efa-4bd9-a1d5-76d0fc679444 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.450541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.451014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.451486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.451764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.453622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.454871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:03.468487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:03.469832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:03.470897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 361/712] 10.222.0.93 () {56 vars in 1129 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:03.472047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.509429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:03.518133 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.518772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.519046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.536968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.536968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:03.536968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.536968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.538208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 352/713] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:03.541555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.577841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:03.608969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f34f6-1ec1-48cb-a501-94f069571018 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.645410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.646171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.646355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.646590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] PATH_INFO: `/v3/services/network` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.647962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.649874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:03.660518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:03.661797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:03.663518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 362/714] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:03.664934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.670621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790c861-2010-4470-bdf0-6e248d4c397a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.707722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.708804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.709892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.710368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.711275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:03.711789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.713400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.718777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 353/715] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:03.719822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.777126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:03.787164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130b923-2a02-4d2c-b26e-1b98aacd08be None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.823177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:03.826996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.827612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.827937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.828222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.829129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=66a82e8f2e304418adce1935fe7abcb8) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:03.829434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.830929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.836170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe7f13-6719-44c2-b57e-d925a2394581 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.844932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 363/716] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/role_assignments?user.id=66a82e8f2e304418adce1935fe7abcb8&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:03.846088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.877788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.878570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.878955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.879471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.880240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:03.880914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.888910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.888910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 354/717] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:03.893973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:04.080084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d75cb5-a6e4-4e13-99e5-a8cfd0048d87 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:04.097306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb01be-2d0a-4be1-8be7-1048b1a84ca0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:04.132442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6a25f-b987-443c-bd5b-c19debff9c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:04.133298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a25f-b987-443c-bd5b-c19debff9c59 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:04.133680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a25f-b987-443c-bd5b-c19debff9c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:04.134117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a25f-b987-443c-bd5b-c19debff9c59 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:04.134871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6a25f-b987-443c-bd5b-c19debff9c59 None admin] RBAC: Adding query filter params (type=network) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:04.135157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6a25f-b987-443c-bd5b-c19debff9c59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:04.136587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6a25f-b987-443c-bd5b-c19debff9c59 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:04.142833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 355/718] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:04.158894 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9ec3b-411b-4e3c-a9c2-3523c9fbf00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:04.159784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ec3b-411b-4e3c-a9c2-3523c9fbf00d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:04.160169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ec3b-411b-4e3c-a9c2-3523c9fbf00d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:04.160548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9ec3b-411b-4e3c-a9c2-3523c9fbf00d None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:04.161639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9ec3b-411b-4e3c-a9c2-3523c9fbf00d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:04.162063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9ec3b-411b-4e3c-a9c2-3523c9fbf00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:04.164709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9ec3b-411b-4e3c-a9c2-3523c9fbf00d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:04.174216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 364/719] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:05.185312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6130-c656-4a49-b542-60e889ea08cb None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.186331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6130-c656-4a49-b542-60e889ea08cb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.186812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6130-c656-4a49-b542-60e889ea08cb None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.188629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 356/720] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:05.194961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432349-22c7-4fe5-9bca-0b3544ab28bc None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.195974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432349-22c7-4fe5-9bca-0b3544ab28bc None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.196447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432349-22c7-4fe5-9bca-0b3544ab28bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.217462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b1432349-22c7-4fe5-9bca-0b3544ab28bc None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:05.219059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b1432349-22c7-4fe5-9bca-0b3544ab28bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:05.235170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:05.293371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 365/721] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 21:05:05.317729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6130-c656-4a49-b542-60e889ea08cb None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.345426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:05.439247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6130-c656-4a49-b542-60e889ea08cb None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.475634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b0a5-7629-4d52-80ce-3a0ddf233968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.476286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b0a5-7629-4d52-80ce-3a0ddf233968 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.476567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b0a5-7629-4d52-80ce-3a0ddf233968 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.476842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b0a5-7629-4d52-80ce-3a0ddf233968 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.487882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485b0a5-7629-4d52-80ce-3a0ddf233968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-7485b0a5-7629-4d52-80ce-3a0ddf233968 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:05.493786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:05.494798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:05.496058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 357/722] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:05.503511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432349-22c7-4fe5-9bca-0b3544ab28bc None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.639242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432349-22c7-4fe5-9bca-0b3544ab28bc None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.689445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b95db-e958-4bc3-8796-625d9140226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.690006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b95db-e958-4bc3-8796-625d9140226e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.690288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b95db-e958-4bc3-8796-625d9140226e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.690565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b95db-e958-4bc3-8796-625d9140226e None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.691369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b95db-e958-4bc3-8796-625d9140226e None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:05.691679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b95db-e958-4bc3-8796-625d9140226e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.693167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b95db-e958-4bc3-8796-625d9140226e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.706147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 366/723] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:05.712064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b0a5-7629-4d52-80ce-3a0ddf233968 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.755039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e804a94-8fbd-4394-8147-79b5d1d91549 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.755039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e804a94-8fbd-4394-8147-79b5d1d91549 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.755039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e804a94-8fbd-4394-8147-79b5d1d91549 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.756143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 367/724] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:05.763439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d15115-45f0-43a4-a0ad-3a0632a719f6 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.763758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d15115-45f0-43a4-a0ad-3a0632a719f6 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.764123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d15115-45f0-43a4-a0ad-3a0632a719f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.794338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-43d15115-45f0-43a4-a0ad-3a0632a719f6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:05.795551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-43d15115-45f0-43a4-a0ad-3a0632a719f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:05.806395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:05.817519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:05.842213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b0a5-7629-4d52-80ce-3a0ddf233968 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.888953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.891141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.891670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.892142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.922062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.923540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.958939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 368/725] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:05.959685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:05.960744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:05.961856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:05.961856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:05.961856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:05.961856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:05.961856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 358/726] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:05.966670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d15115-45f0-43a4-a0ad-3a0632a719f6 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.004183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.123469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18794ea8-4a0d-44c6-97e3-b3e7c39c0b18 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.165230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d15115-45f0-43a4-a0ad-3a0632a719f6 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.165432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.178851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b7d2-d786-4907-856c-673c241d824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.179885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b7d2-d786-4907-856c-673c241d824e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.180363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b7d2-d786-4907-856c-673c241d824e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.180828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b7d2-d786-4907-856c-673c241d824e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.206731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8b7d2-d786-4907-856c-673c241d824e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-32a8b7d2-d786-4907-856c-673c241d824e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:06.218847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:06.219815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:06.221146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 359/727] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:06.226177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b7d2-d786-4907-856c-673c241d824e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.237736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.239567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.240102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.240797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.241804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:06.242335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.243947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.254500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.259858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 369/728] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:06.265958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.365196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b7d2-d786-4907-856c-673c241d824e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.421239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a79ad-d293-43d8-b14f-040d95d93329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.421874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a79ad-d293-43d8-b14f-040d95d93329 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.422151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a79ad-d293-43d8-b14f-040d95d93329 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.422419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a79ad-d293-43d8-b14f-040d95d93329 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.423141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a79ad-d293-43d8-b14f-040d95d93329 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:06.423444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a79ad-d293-43d8-b14f-040d95d93329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.424811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a79ad-d293-43d8-b14f-040d95d93329 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.441035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 360/729] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:06.442524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96749d-e576-4c93-a6bf-e37e5e5ae15e None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.442812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96749d-e576-4c93-a6bf-e37e5e5ae15e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.443089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96749d-e576-4c93-a6bf-e37e5e5ae15e None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.448927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 361/730] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:06.448927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96749d-e576-4c93-a6bf-e37e5e5ae15e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.517257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.579051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96749d-e576-4c93-a6bf-e37e5e5ae15e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.600481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea9b39-b19e-4fd9-84a3-cb87a32cf033 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.627501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450fdb1-b062-4bb7-a3bc-778a35022504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.628467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450fdb1-b062-4bb7-a3bc-778a35022504 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.628951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450fdb1-b062-4bb7-a3bc-778a35022504 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.629400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450fdb1-b062-4bb7-a3bc-778a35022504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.641114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450fdb1-b062-4bb7-a3bc-778a35022504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.643060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450fdb1-b062-4bb7-a3bc-778a35022504 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.644108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.644855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.645236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.645579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.656660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.658250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-7450fdb1-b062-4bb7-a3bc-778a35022504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:06.662273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:06.663730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:06.664609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:06.664609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:06.664609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:06.664609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:06.671523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 362/731] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:06.672122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:06.673068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:06.674502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 370/732] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:06.675975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.676856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d02d4-0dda-4873-90ba-3b2088b9f3a0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.677365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d02d4-0dda-4873-90ba-3b2088b9f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.677809 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d02d4-0dda-4873-90ba-3b2088b9f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.698331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1a6d02d4-0dda-4873-90ba-3b2088b9f3a0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:06.699849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1a6d02d4-0dda-4873-90ba-3b2088b9f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:06.764052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.800980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 363/733] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:05:06.802239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d02d4-0dda-4873-90ba-3b2088b9f3a0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.832847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47ec43-f1fa-4ca4-9947-92f123070bd1 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.853097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.877284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.877983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.878331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.878695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.879968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:06.880235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.882329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.901503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 371/734] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:06.901503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.937154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d02d4-0dda-4873-90ba-3b2088b9f3a0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.978673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.979703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.980195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.980693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.981733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:06.982251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.984009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:07.006267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 364/735] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:07.007078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d91ba-85fa-4f88-ad64-454d1015a86e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:07.007672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:07.033589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.047165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718d05-38f8-4715-a39a-43751c88d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:07.047808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718d05-38f8-4715-a39a-43751c88d720 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.048083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718d05-38f8-4715-a39a-43751c88d720 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.048354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718d05-38f8-4715-a39a-43751c88d720 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.070698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c718d05-38f8-4715-a39a-43751c88d720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-6c718d05-38f8-4715-a39a-43751c88d720 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:07.075625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:07.076672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 372/736] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:07.082234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718d05-38f8-4715-a39a-43751c88d720 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:07.136136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.150384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030f231-2425-4836-a078-694d8f127c5c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:07.189782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd585d-dda0-40a6-95a1-43a2d8fec6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:07.190417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd585d-dda0-40a6-95a1-43a2d8fec6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.190687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd585d-dda0-40a6-95a1-43a2d8fec6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.190954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd585d-dda0-40a6-95a1-43a2d8fec6c1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.193091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718d05-38f8-4715-a39a-43751c88d720 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:07.200265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd585d-dda0-40a6-95a1-43a2d8fec6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:07.201741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd585d-dda0-40a6-95a1-43a2d8fec6c1 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-2bfd585d-dda0-40a6-95a1-43a2d8fec6c1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:07.214149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:07.215936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 365/737] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c67d1-478f-4f4f-9ace-03b6239ba5dd None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.217373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c67d1-478f-4f4f-9ace-03b6239ba5dd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.218559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c67d1-478f-4f4f-9ace-03b6239ba5dd None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.219434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 366/738] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:07.219794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c67d1-478f-4f4f-9ace-03b6239ba5dd None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:07.234512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655487c-c190-4617-bd48-e3d59b756ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:07.235135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655487c-c190-4617-bd48-e3d59b756ffb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.235410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655487c-c190-4617-bd48-e3d59b756ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.235680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655487c-c190-4617-bd48-e3d59b756ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.296794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.320635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655487c-c190-4617-bd48-e3d59b756ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:07.322194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655487c-c190-4617-bd48-e3d59b756ffb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:07.335317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c67d1-478f-4f4f-9ace-03b6239ba5dd None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:07.372067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f33ea-fa35-4511-a788-5c9ec4c87374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:07.372683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f33ea-fa35-4511-a788-5c9ec4c87374 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.372992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f33ea-fa35-4511-a788-5c9ec4c87374 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.373262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f33ea-fa35-4511-a788-5c9ec4c87374 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.374135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f33ea-fa35-4511-a788-5c9ec4c87374 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:07.374589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f33ea-fa35-4511-a788-5c9ec4c87374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:07.376020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f33ea-fa35-4511-a788-5c9ec4c87374 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:07.385102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 367/739] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:07.386360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecdde5-74d7-40ef-a9ff-224a27ce9cab None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.386642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecdde5-74d7-40ef-a9ff-224a27ce9cab None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.386913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecdde5-74d7-40ef-a9ff-224a27ce9cab None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.388270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 368/740] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:07.389147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ddf1b-a3bb-43ce-8fd4-c9c071508336 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.389429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ddf1b-a3bb-43ce-8fd4-c9c071508336 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.389697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ddf1b-a3bb-43ce-8fd4-c9c071508336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.408312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c53ddf1b-a3bb-43ce-8fd4-c9c071508336 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:07.409555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c53ddf1b-a3bb-43ce-8fd4-c9c071508336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:07.420768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.468606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 373/741] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:07.469491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655487c-c190-4617-bd48-e3d59b756ffb None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:07.487447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 369/742] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:05:07.488287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ddf1b-a3bb-43ce-8fd4-c9c071508336 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:07.568103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.589272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655487c-c190-4617-bd48-e3d59b756ffb None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:07.617898 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ddf1b-a3bb-43ce-8fd4-c9c071508336 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:07.628599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800640ef-22da-4675-b442-6c95f6650fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:07.629374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800640ef-22da-4675-b442-6c95f6650fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.629733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800640ef-22da-4675-b442-6c95f6650fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.630079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800640ef-22da-4675-b442-6c95f6650fe3 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.631500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800640ef-22da-4675-b442-6c95f6650fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:07.631896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800640ef-22da-4675-b442-6c95f6650fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:07.633823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800640ef-22da-4675-b442-6c95f6650fe3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:07.652648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 374/743] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Aug 4 21:05:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:07.653927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fffa-d811-41ed-b871-80127023c13c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.654208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fffa-d811-41ed-b871-80127023c13c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.654486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fffa-d811-41ed-b871-80127023c13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.655779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:07.656599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.657155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.657618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.668967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:07.670731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:07.673086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-2411fffa-d811-41ed-b871-80127023c13c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:07.674307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-2411fffa-d811-41ed-b871-80127023c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:07.674510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:07.691028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:07.698401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:07.699541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:07.699541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:07.699541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:07.699541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:07.699541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 370/744] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:07.699541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:07.750042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 375/745] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 21:05:07.750864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411fffa-d811-41ed-b871-80127023c13c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:07.815097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5f00-babe-4264-b34f-520efeb6a6f0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:07.826588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.852339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:07.852908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.853371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.853563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.862225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411fffa-d811-41ed-b871-80127023c13c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:07.865513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:07.867485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:07.883164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:07.884312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:07.885415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:07.885415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:07.885415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:07.885415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:07.887271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 371/746] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:07.888269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:07.909399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cbcec-d52b-4b22-8b17-16723284c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:07.910014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cbcec-d52b-4b22-8b17-16723284c79c None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:07.910288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cbcec-d52b-4b22-8b17-16723284c79c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:07.910582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cbcec-d52b-4b22-8b17-16723284c79c None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:07.911255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cbcec-d52b-4b22-8b17-16723284c79c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:07.913021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cbcec-d52b-4b22-8b17-16723284c79c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:07.938558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:07.991151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2ba3e-ea5f-46ee-8c97-ac1a57f06272 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.004467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 376/747] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:05:07 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:08.005624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cbcec-d52b-4b22-8b17-16723284c79c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.046290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62474346-a5b5-411c-ae21-8b2064068ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.046936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62474346-a5b5-411c-ae21-8b2064068ffd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.047218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62474346-a5b5-411c-ae21-8b2064068ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.047490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62474346-a5b5-411c-ae21-8b2064068ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.135673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62474346-a5b5-411c-ae21-8b2064068ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.137087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62474346-a5b5-411c-ae21-8b2064068ffd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.145003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cbcec-d52b-4b22-8b17-16723284c79c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.179841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:08.187052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.187697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.187956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.189152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.189275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:08.189359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:08.189359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.190680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.204462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 377/748] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:08.205416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.251849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 372/749] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:07 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 21:05:08.252695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62474346-a5b5-411c-ae21-8b2064068ffd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.323748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ecc1a-66b3-404c-8bc7-9d1a98d2c32f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.366913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62474346-a5b5-411c-ae21-8b2064068ffd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.374781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53389b-b737-495e-bf94-ab21d8f48594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.375784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53389b-b737-495e-bf94-ab21d8f48594 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.376112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53389b-b737-495e-bf94-ab21d8f48594 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.376498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53389b-b737-495e-bf94-ab21d8f48594 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.377725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53389b-b737-495e-bf94-ab21d8f48594 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.379610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53389b-b737-495e-bf94-ab21d8f48594 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.418344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.418915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.419153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.419414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.420137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:08.420435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.421830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.434822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 373/750] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:08.435651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.435801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 378/751] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:05:08 2022] POST /identity/v3/services => generated 240 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:08.436753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53389b-b737-495e-bf94-ab21d8f48594 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.447956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:08.533979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:08.616584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c788e-d290-4f38-b348-d8c47fea9e4d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.621140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53389b-b737-495e-bf94-ab21d8f48594 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.664061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.665796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.665796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.666111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.668166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.668867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.669190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.669569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.679811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.681480 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.683748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.685339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:08.698769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:08.699743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:08.700676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:08.702538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:08.703374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:08.704626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:08.704626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:08.704626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:08.704626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:08.704626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 379/752] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:08.704934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.706121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 374/753] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:08.711032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.793394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:08.814288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:08.820659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f6ae5-6211-4bfe-92d8-980bf6351e55 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.833044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8ad2-5e58-4121-b5fb-95baae29a8b0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.858080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.858730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.859022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.859278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.866521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.868401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.872789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.873448 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.873742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.873993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.874682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:08.874985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.876351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:08.880935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:08.881942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:08.882942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:08.882942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:08.882942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:08.882942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:08.882942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:08.882942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:08.882942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:08.882942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:08.887024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 380/754] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:08.887865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.889093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 375/755] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:08.889929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.008316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b1479-fafb-47d7-9a6d-5d5ce41bad41 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.008671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fa25d-bc40-49bd-9341-bf172674ac33 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.039306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:09.048714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.049567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.049988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.051186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.051456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:09.051592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.052032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.052214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.052495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.052782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.053567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:09.053902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.054762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.055321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.073788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 376/756] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:09.073788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.079906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 381/757] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:09.081259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.099232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:09.183903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0c35-88d1-49ad-96fc-5c0bb064ad8d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.191586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7a109-b2f2-4c9a-8734-2456d3532a7c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.230165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.230929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.231212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.231488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.233369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.234235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.234698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.235138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.236106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=f412bc92d203449fb04f3d2c1194f937) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:09.236604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.238345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.239663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.241659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.253061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 382/758] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:09 2022] GET /identity/v3/role_assignments?user.id=f412bc92d203449fb04f3d2c1194f937&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:09.254354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:09.256838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:09.258412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:09.259759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 377/759] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:09.264173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.371810 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:09.380843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:09.405777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c540f78-db1d-43ea-aa5c-e30464bb6c7c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.455021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.455686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.455976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.456250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.471694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.473209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:09.508152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:09.509133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:09.510071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:09.510071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:09.510071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:09.510071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:09.516643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 383/760] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:09.520012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.534641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28ebee-3f06-4f11-a098-6d439a730aa7 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.600612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.601271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.601550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.601825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.602611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:09.602919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.604368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.634419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 378/761] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:09.640268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.726194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ada1ba-0751-4155-9cf6-a42fb5df053a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.758439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:09.765587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.766166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.766451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.766735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.767446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:09.767751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.769177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.782405 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 384/762] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:09.788261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.882071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d2850-494c-42f4-857c-8a3e97aa36b1 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.890660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:09.935911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e11b1-0927-48fe-acd3-28c65e35a15e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.961572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.962527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.962980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.963405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.964334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=348efd4e6a0948afb8b0015d9bfb1d08) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:09.964790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.967788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.983147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 379/763] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:09 2022] GET /identity/v3/role_assignments?user.id=348efd4e6a0948afb8b0015d9bfb1d08&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:09.991643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.992920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.993381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.993805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.010271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.012058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:10.029953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:10.031093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:10.032197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:10.032197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:10.032197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:10.032197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:10.032197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:10.032197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:10.032197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:10.032197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:10.039920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.040416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 385/764] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:10.215069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bbe3b-538a-46a1-af5c-954a74ce2216 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.254294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461a80b-5b2e-41c9-af30-0d5e9eb49114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.254911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a80b-5b2e-41c9-af30-0d5e9eb49114 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.255184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a80b-5b2e-41c9-af30-0d5e9eb49114 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.255453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461a80b-5b2e-41c9-af30-0d5e9eb49114 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.256246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461a80b-5b2e-41c9-af30-0d5e9eb49114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:10.256742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461a80b-5b2e-41c9-af30-0d5e9eb49114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.258443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461a80b-5b2e-41c9-af30-0d5e9eb49114 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.271280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 380/765] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:10.277865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.300142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8145-b113-4ea5-b588-bea5cd47ff12 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.300331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8145-b113-4ea5-b588-bea5cd47ff12 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.300607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8145-b113-4ea5-b588-bea5cd47ff12 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.302432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 381/766] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:10.308409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f227-4adf-4113-aebd-020d8d1b6db5 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.308689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f227-4adf-4113-aebd-020d8d1b6db5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.308987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f227-4adf-4113-aebd-020d8d1b6db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.341930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6d98f227-4adf-4113-aebd-020d8d1b6db5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:10.343127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6d98f227-4adf-4113-aebd-020d8d1b6db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:10.345361 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:10.394651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:10.402839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcc868-deea-4f76-947b-f71a4a64d535 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.448899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2615b-d65b-4aca-9ff8-dacfa67bab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.449940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2615b-d65b-4aca-9ff8-dacfa67bab4c None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.450222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2615b-d65b-4aca-9ff8-dacfa67bab4c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.450494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2615b-d65b-4aca-9ff8-dacfa67bab4c None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/66a82e8f2e304418adce1935fe7abcb8/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.456981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2615b-d65b-4aca-9ff8-dacfa67bab4c None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=66a82e8f2e304418adce1935fe7abcb8, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.458538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2615b-d65b-4aca-9ff8-dacfa67bab4c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.485407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 382/767] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:10.509887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98f227-4adf-4113-aebd-020d8d1b6db5 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.555486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 386/768] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:05:10 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/66a82e8f2e304418adce1935fe7abcb8/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:10.645699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98f227-4adf-4113-aebd-020d8d1b6db5 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.698532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c2f6e-9668-4d5c-8178-414587d94486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.699197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2f6e-9668-4d5c-8178-414587d94486 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.699473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2f6e-9668-4d5c-8178-414587d94486 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.699744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2f6e-9668-4d5c-8178-414587d94486 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.700379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c2f6e-9668-4d5c-8178-414587d94486 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.701794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c2f6e-9668-4d5c-8178-414587d94486 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-549c2f6e-9668-4d5c-8178-414587d94486 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:10.716867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:10.717911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:10.718788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 383/769] 10.222.0.93 () {56 vars in 1129 bytes} [Thu Aug 4 21:05:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:10.726756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2615b-d65b-4aca-9ff8-dacfa67bab4c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.855414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa388-60b4-40dd-a41f-59170821fbb9 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.855597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa388-60b4-40dd-a41f-59170821fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.855875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaa388-60b4-40dd-a41f-59170821fbb9 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.855990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2615b-d65b-4aca-9ff8-dacfa67bab4c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.858549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 384/770] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:10.862572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef213b-67e9-4562-9e1f-128ecda5626f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.862850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef213b-67e9-4562-9e1f-128ecda5626f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.863119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef213b-67e9-4562-9e1f-128ecda5626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.873266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:10.886025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-64ef213b-67e9-4562-9e1f-128ecda5626f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:10.887214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-64ef213b-67e9-4562-9e1f-128ecda5626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:10.898782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.899422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.899706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.899979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.900658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:10.900993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.902742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.905033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:10.915282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 387/771] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Aug 4 21:05:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:10.921480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.969938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 385/772] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:11.005505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef213b-67e9-4562-9e1f-128ecda5626f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.105533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5273e1-caf5-4123-9a8f-ee6e265585ec None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.186966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.187598 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.187876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.188147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.188825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:11.189154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.193694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.210849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 388/773] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Aug 4 21:05:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:11.214729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef213b-67e9-4562-9e1f-128ecda5626f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.227437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.301261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:11.313400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.314064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.314343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.314613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] PATH_INFO: `/v3/services/network` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.315252 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.316624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:11.339211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:11.340308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:11.341188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:11.342467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa3a0-8523-49ad-8201-59326985a669 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.346543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 386/774] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:11 2022] GET /identity/v3/services/network => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:11.353394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.382094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.383540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.384004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.384454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.385520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] RBAC: Adding query filter params (interface=public, service_id=f4fec0510ea04dfd8b91d1d3d8b37bf1, region_id=RegionOne) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:11.386134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.387707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.397869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 389/775] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Aug 4 21:05:11 2022] GET /identity/v3/endpoints?service_id=f4fec0510ea04dfd8b91d1d3d8b37bf1&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:11.403596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:11.404594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.527487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9670e1-fd88-492b-a45f-00033b0021f5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.541317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:11.569659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8abc2-6079-4c9d-8c16-8f1bc85ff42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.570590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8abc2-6079-4c9d-8c16-8f1bc85ff42a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.571049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8abc2-6079-4c9d-8c16-8f1bc85ff42a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.571502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8abc2-6079-4c9d-8c16-8f1bc85ff42a None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.572377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8abc2-6079-4c9d-8c16-8f1bc85ff42a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.574801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8abc2-6079-4c9d-8c16-8f1bc85ff42a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.581517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 390/776] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:05:11 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:11.616162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5694-f59a-4d00-a8a9-0fc81022a820 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.680557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9aefb-9658-43ef-80f8-ee19e8ded4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.681145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9aefb-9658-43ef-80f8-ee19e8ded4ea None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.681426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9aefb-9658-43ef-80f8-ee19e8ded4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.681699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9aefb-9658-43ef-80f8-ee19e8ded4ea None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.682385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9aefb-9658-43ef-80f8-ee19e8ded4ea None admin] RBAC: Adding query filter params (name=network) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:11.682687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9aefb-9658-43ef-80f8-ee19e8ded4ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.684071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9aefb-9658-43ef-80f8-ee19e8ded4ea None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.694328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 387/777] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:11.699883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8abc2-6079-4c9d-8c16-8f1bc85ff42a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.736563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947392-ca34-4f36-a249-c18d7ffc898f None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.736942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947392-ca34-4f36-a249-c18d7ffc898f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.737142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947392-ca34-4f36-a249-c18d7ffc898f None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.738529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 388/778] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:11.746666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a8ca-fe1d-499d-9267-cf1fbcff9e65 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.747744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a8ca-fe1d-499d-9267-cf1fbcff9e65 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.749200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a8ca-fe1d-499d-9267-cf1fbcff9e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.785760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9457a8ca-fe1d-499d-9267-cf1fbcff9e65 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:11.787058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9457a8ca-fe1d-499d-9267-cf1fbcff9e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:11.865047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8abc2-6079-4c9d-8c16-8f1bc85ff42a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.888877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 389/779] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:11.908605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.909272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.909553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.909824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.910723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:11.911027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.912782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.923544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 391/780] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:11.924973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457a8ca-fe1d-499d-9267-cf1fbcff9e65 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.931599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.949334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:11.981330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:12.056036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330986e-fe81-4002-9f88-ad685d2dc1a8 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.096181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd907-021d-4e32-a742-ae6fb6874557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.097245 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd907-021d-4e32-a742-ae6fb6874557 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.097775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd907-021d-4e32-a742-ae6fb6874557 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.098383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd907-021d-4e32-a742-ae6fb6874557 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.111517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcd907-021d-4e32-a742-ae6fb6874557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-9dbcd907-021d-4e32-a742-ae6fb6874557 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:12.117863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:12.118795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:05:12.119665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:12.122425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 392/781] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:12.130015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd907-021d-4e32-a742-ae6fb6874557 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.240090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd907-021d-4e32-a742-ae6fb6874557 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.253406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:12.270621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457a8ca-fe1d-499d-9267-cf1fbcff9e65 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.307603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.309843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.310330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.310947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.313118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:12.313666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.315946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.324247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.333025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.333025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.333025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.333025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] RBAC: Adding query filter params (interface=public, service_id=9ed80d7d73824182af13142338c1c7a5, region_id=RegionOne) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:12.333025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.333385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 393/782] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:05:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:12.333462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.337365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.346363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 390/783] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Aug 4 21:05:11 2022] GET /identity/v3/endpoints?service_id=9ed80d7d73824182af13142338c1c7a5&interface=public®ion_id=RegionOne => generated 194 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:12.351548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.499408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:12.529360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb41b1-9013-45f3-8487-fedcd7a3deab None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.565277 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e31b8-5e71-44f9-951e-d82bb397ef4c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.570237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.571308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.571759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.572251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.585775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.587238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:12.602965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:12.603936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:12.604835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:12.604835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:12.604835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:12.604835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:12.604835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 394/784] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:12.611144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.616974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:12.631287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910d527-b52b-430d-832d-e35d683224f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.631908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d527-b52b-430d-832d-e35d683224f7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.632190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d527-b52b-430d-832d-e35d683224f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.632466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d527-b52b-430d-832d-e35d683224f7 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.637587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910d527-b52b-430d-832d-e35d683224f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.637587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910d527-b52b-430d-832d-e35d683224f7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.643347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 391/785] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:05:12 2022] GET /identity/v3/services => generated 772 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:12.644745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ced8d-0891-49a1-a55f-7164435088f9 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.645139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ced8d-0891-49a1-a55f-7164435088f9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.645487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ced8d-0891-49a1-a55f-7164435088f9 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.652242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 392/786] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:12.654118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4969-b567-47b6-8c9e-04ee594ee937 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.654405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4969-b567-47b6-8c9e-04ee594ee937 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.654687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4969-b567-47b6-8c9e-04ee594ee937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.678550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a86a4969-b567-47b6-8c9e-04ee594ee937 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:12.679834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a86a4969-b567-47b6-8c9e-04ee594ee937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:12.777175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 393/787] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:12.805365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121403b9-678c-4746-8b12-de1ea08f2862 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.825204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a4969-b567-47b6-8c9e-04ee594ee937 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.864388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.865264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.866086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.866361 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.867158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:12.867464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.868859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.882491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 395/788] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:12.890252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.913857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:12.958261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a4969-b567-47b6-8c9e-04ee594ee937 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.967328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.002312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80809b9d-d83d-4102-9824-6e13b49672fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.003237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809b9d-d83d-4102-9824-6e13b49672fc None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.003664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809b9d-d83d-4102-9824-6e13b49672fc None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.004145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809b9d-d83d-4102-9824-6e13b49672fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.015386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80809b9d-d83d-4102-9824-6e13b49672fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-80809b9d-d83d-4102-9824-6e13b49672fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:13.020736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:13.021783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:13.022624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:13.023257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efa375-afcd-43e3-a6b7-3efe5a7128e0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.025418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 394/789] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:13.026837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de352fd-f131-49e2-ad6a-4230b4fbc889 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.027481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de352fd-f131-49e2-ad6a-4230b4fbc889 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.028003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de352fd-f131-49e2-ad6a-4230b4fbc889 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.029744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 395/790] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:13.034507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de352fd-f131-49e2-ad6a-4230b4fbc889 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.071021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ceeb3-d89f-4629-971e-9adbee7c0ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.072084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceeb3-d89f-4629-971e-9adbee7c0ccf None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.072622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceeb3-d89f-4629-971e-9adbee7c0ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.073125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceeb3-d89f-4629-971e-9adbee7c0ccf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.082000 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ceeb3-d89f-4629-971e-9adbee7c0ccf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.083874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ceeb3-d89f-4629-971e-9adbee7c0ccf None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-490ceeb3-d89f-4629-971e-9adbee7c0ccf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:13.099376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:13.100413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:13.101422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:13.104219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 396/791] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:05:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:13.105779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbef1e-0ecb-47d3-beda-8cc3280486b4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.106270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbef1e-0ecb-47d3-beda-8cc3280486b4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.106764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbef1e-0ecb-47d3-beda-8cc3280486b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.127285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-fedbef1e-0ecb-47d3-beda-8cc3280486b4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:13.128844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fedbef1e-0ecb-47d3-beda-8cc3280486b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.176776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de352fd-f131-49e2-ad6a-4230b4fbc889 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.203932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 397/792] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:13.205183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbef1e-0ecb-47d3-beda-8cc3280486b4 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.228513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.242148 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.242770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.243463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.243748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.244469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:13.244798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.246236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.264330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 396/793] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:13.265859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.298779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.346187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbef1e-0ecb-47d3-beda-8cc3280486b4 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.386610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.387380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.387754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.388218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.389153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:13.389594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.391109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.399519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dedc2-5d45-4ed4-8376-35557b733e8e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.416166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 398/794] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:13.417694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.442056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ebac-a3a0-4807-a851-6d407046d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.443114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ebac-a3a0-4807-a851-6d407046d7eb None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.443615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ebac-a3a0-4807-a851-6d407046d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.444362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ebac-a3a0-4807-a851-6d407046d7eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.457862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70ebac-a3a0-4807-a851-6d407046d7eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-2e70ebac-a3a0-4807-a851-6d407046d7eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:13.464707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:13.465843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:13.466688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:13.473516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 397/795] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:13.473516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ebac-a3a0-4807-a851-6d407046d7eb None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.553361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.557785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83452433-ed07-4da9-85af-8ea19bc73b42 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.577492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.602458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ebac-a3a0-4807-a851-6d407046d7eb None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.607816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.609012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.609543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.610091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.624220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.626537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.643125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.643779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.644060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.644336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:13.651351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:13.652307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:13.653260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:13.653260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:13.653260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:13.653260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:13.659399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 399/796] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:13.659399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.662978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.665564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:13.685823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:13.686796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:13.687678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:13.687678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:13.687678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:13.687678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:13.689927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 398/797] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:13.691314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.786059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9444-a4a0-48d2-8057-b4f873b2db45 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.815899 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48b1da-b239-4c70-b438-d9e7208620e2 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.818113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.838102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.838977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.839412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.839833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.841165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:13.841654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.843671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.861124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.861124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.861124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.861124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.861636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:13.861636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.861636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.862167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 400/798] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:13.863962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.880111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 399/799] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:13.880111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.905326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.996622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6993f-9174-40ed-b8de-eaad5c5389b0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.017954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321e4f3-8d72-4421-9167-eaf08d9a4e9b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.035313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.036097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.036536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.036854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.038653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:14.038653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.040369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.054724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 401/800] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:14.055552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.063919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.065297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.065731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.066203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.080393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.082402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:14.100248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:14.101217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:14.107505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:14.107505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:14.107505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:14.107505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:14.107505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 400/801] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:14.107505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.130189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.158696 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.178650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5770c8b-1a3e-4b07-8494-904c435f8363 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.219522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e04048-4d10-4f82-a1ef-764fa0448327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.220173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e04048-4d10-4f82-a1ef-764fa0448327 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.220705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e04048-4d10-4f82-a1ef-764fa0448327 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.220705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e04048-4d10-4f82-a1ef-764fa0448327 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.224168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ea953-472c-4b66-9fda-0575361a0a2d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.228511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e04048-4d10-4f82-a1ef-764fa0448327 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.229995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e04048-4d10-4f82-a1ef-764fa0448327 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-f3e04048-4d10-4f82-a1ef-764fa0448327 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:14.242108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:14.243268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:14.244277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 402/802] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:14.245250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6eaee-dea3-44c1-a4fb-a44cb82b0f88 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.245250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6eaee-dea3-44c1-a4fb-a44cb82b0f88 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.245250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6eaee-dea3-44c1-a4fb-a44cb82b0f88 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.246541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 403/803] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:14.249653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6eaee-dea3-44c1-a4fb-a44cb82b0f88 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.273679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.274381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.274657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.275011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.282478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.283924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:14.296408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:14.297979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:14.299009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 401/804] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:14.301464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.370754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6eaee-dea3-44c1-a4fb-a44cb82b0f88 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.392493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.412079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89000c-e8ea-4d29-a2e8-ab8e2d84e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.412915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89000c-e8ea-4d29-a2e8-ab8e2d84e819 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.413600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89000c-e8ea-4d29-a2e8-ab8e2d84e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.413884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89000c-e8ea-4d29-a2e8-ab8e2d84e819 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.414838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89000c-e8ea-4d29-a2e8-ab8e2d84e819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:14.415149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89000c-e8ea-4d29-a2e8-ab8e2d84e819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.416595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89000c-e8ea-4d29-a2e8-ab8e2d84e819 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.419766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93c308-42d0-46c6-ac40-5edde3a04b29 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.431233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 404/805] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:14.436845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0cd6f-6ab1-491f-95cf-78b8a5a2a421 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.437174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0cd6f-6ab1-491f-95cf-78b8a5a2a421 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.437454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0cd6f-6ab1-491f-95cf-78b8a5a2a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.451183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.457148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-59b0cd6f-6ab1-491f-95cf-78b8a5a2a421 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:14.459761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-59b0cd6f-6ab1-491f-95cf-78b8a5a2a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:14.467707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.467977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.468281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.468532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.469355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:14.469858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.471173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.492388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 402/806] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:14.492388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.540972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 405/807] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:14.542299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0cd6f-6ab1-491f-95cf-78b8a5a2a421 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.625565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310d8d0-2b3a-47e6-b66a-d2465b0b9449 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.658214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.661873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0cd6f-6ab1-491f-95cf-78b8a5a2a421 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.664189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.664828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.665166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.665436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.679971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:14.679971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.679971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.682291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 403/808] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:14.683285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.705818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.706473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.706776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.707657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.711659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.717004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.718645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:14.736110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:14.737367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:14.738358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:14.738948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 406/809] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:14.739536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.800816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbff5d-3ba6-477d-a1fb-7e5514495738 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.851665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.853111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.853787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.854237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.855362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2d0b-b542-49c4-9479-4d2f9b5704cb None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.870101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.872565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:14.889613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:14.890547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:14.891676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:14.891676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:14.891676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:14.891676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:14.891676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 404/810] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:14.891950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.893895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.894545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.894823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.895094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.895722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.897728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:14.906975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:14.908073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:14.909118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 407/811] 10.222.0.93 () {56 vars in 1129 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:14.911206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.950377 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.973044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:15.010992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed58ad-228f-4b60-aa36-dbbac0cce41e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.015801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54906492-3d72-4dfb-a5bf-96f846ac6be5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.044944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99771fbd-c7b3-4482-adea-bee672ddf76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.045608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99771fbd-c7b3-4482-adea-bee672ddf76d None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.045885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99771fbd-c7b3-4482-adea-bee672ddf76d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.046156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99771fbd-c7b3-4482-adea-bee672ddf76d None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/f412bc92d203449fb04f3d2c1194f937/roles/7647001353b54c2789f738144d1189c7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.048840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975799de-42f4-49c2-9573-3b288824424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.049483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975799de-42f4-49c2-9573-3b288824424f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.049761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975799de-42f4-49c2-9573-3b288824424f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.050040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975799de-42f4-49c2-9573-3b288824424f None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.050821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975799de-42f4-49c2-9573-3b288824424f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:15.051127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975799de-42f4-49c2-9573-3b288824424f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.053109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975799de-42f4-49c2-9573-3b288824424f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.061882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99771fbd-c7b3-4482-adea-bee672ddf76d None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=f412bc92d203449fb04f3d2c1194f937, role_id=7647001353b54c2789f738144d1189c7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.063312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99771fbd-c7b3-4482-adea-bee672ddf76d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.071722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 408/812] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:15.072992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee969-475a-42e9-84eb-975b4fdee6b9 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.073280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee969-475a-42e9-84eb-975b4fdee6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.073557 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fee969-475a-42e9-84eb-975b4fdee6b9 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.074745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 409/813] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:15.075425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fee969-475a-42e9-84eb-975b4fdee6b9 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.119549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 405/814] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:05:14 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/f412bc92d203449fb04f3d2c1194f937/roles/7647001353b54c2789f738144d1189c7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:15.120462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99771fbd-c7b3-4482-adea-bee672ddf76d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.189269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fee969-475a-42e9-84eb-975b4fdee6b9 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.210270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:15.229680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.230316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.230596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.231026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:15.232401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.233152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:15.233955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.235846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.238512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99771fbd-c7b3-4482-adea-bee672ddf76d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.250494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 410/815] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:15.251592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.290413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af820bcc-8bc3-4875-98f4-27f9ac77c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.291043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af820bcc-8bc3-4875-98f4-27f9ac77c6eb None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.291313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af820bcc-8bc3-4875-98f4-27f9ac77c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.291589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af820bcc-8bc3-4875-98f4-27f9ac77c6eb None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.292594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af820bcc-8bc3-4875-98f4-27f9ac77c6eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:15.292911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af820bcc-8bc3-4875-98f4-27f9ac77c6eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.294491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af820bcc-8bc3-4875-98f4-27f9ac77c6eb None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.299262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 406/816] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:15.300505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2828d23-91d6-47da-a107-2190b001a747 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.300745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2828d23-91d6-47da-a107-2190b001a747 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.301067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2828d23-91d6-47da-a107-2190b001a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.321926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f2828d23-91d6-47da-a107-2190b001a747 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:15.323215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f2828d23-91d6-47da-a107-2190b001a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:15.373413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9176-3b70-4de7-8619-9b778a6d05e3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.400352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 407/817] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:15.401231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2828d23-91d6-47da-a107-2190b001a747 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.419987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c38a-359b-44a4-a7ab-f9f23b4171bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.420969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c38a-359b-44a4-a7ab-f9f23b4171bd None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.421500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c38a-359b-44a4-a7ab-f9f23b4171bd None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.421969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250c38a-359b-44a4-a7ab-f9f23b4171bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.472846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:15.503573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c38a-359b-44a4-a7ab-f9f23b4171bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.505519 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250c38a-359b-44a4-a7ab-f9f23b4171bd None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.508560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:15.520659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2828d23-91d6-47da-a107-2190b001a747 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.565367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.566009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.566288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.566549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.573683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.575124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:15.588369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:15.589402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:15.590403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 408/818] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:15.590904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.638837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 411/819] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:05:15.639688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c38a-359b-44a4-a7ab-f9f23b4171bd None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.726287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067934-3fa8-4a9f-b7ef-c6d3fd1fa8ad None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.750552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:15.774877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250c38a-359b-44a4-a7ab-f9f23b4171bd None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.777022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.777657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.777933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.778206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.778884 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:15.779184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.780547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.787491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 409/820] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:15.788609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.806673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:15.816660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.817339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.817613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.817884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] PATH_INFO: `/v3/services/network` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.819264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.820923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:15.832989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:15.834232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:15.835178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 412/821] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:15.837589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.927959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d013a1-5b5a-4535-ad41-3ff16cb94429 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.954055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5abe2-3f22-419a-96ad-eebe9664bf8f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.971987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.972603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.972898 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.973179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.973923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:15.974223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.976231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.989150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 410/822] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:15.995423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.996518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.997400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.997678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.997947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.011894 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.013401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.015317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:16.028927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:16.031044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:16.032212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:16.032212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:16.032212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:16.032212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:16.032978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 413/823] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:16.034001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.093366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.127392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6364a1-42b8-48f2-bf57-f6efc5e62cc9 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.152058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbf27d-03ae-4f27-868e-ec9122a5fd44 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.166619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f012-250a-4e34-9225-4a2bf97f77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.167495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f012-250a-4e34-9225-4a2bf97f77b6 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.167771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f012-250a-4e34-9225-4a2bf97f77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.168035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f012-250a-4e34-9225-4a2bf97f77b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.168739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6f012-250a-4e34-9225-4a2bf97f77b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.170662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6f012-250a-4e34-9225-4a2bf97f77b6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.189543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.190152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.193056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.193056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.193056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:16.193056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.193056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.199993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 414/824] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:16.199993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.269861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.279586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 411/825] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:16.280571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f012-250a-4e34-9225-4a2bf97f77b6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.346395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64ef9b-4ccd-41fb-a08c-84d6ddb289a9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.399962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cd951-70a8-4978-99d1-1c0a7cdb1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.401141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cd951-70a8-4978-99d1-1c0a7cdb1bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.401851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cd951-70a8-4978-99d1-1c0a7cdb1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.402596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cd951-70a8-4978-99d1-1c0a7cdb1bf4 None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/348efd4e6a0948afb8b0015d9bfb1d08/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.407126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cd951-70a8-4978-99d1-1c0a7cdb1bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=348efd4e6a0948afb8b0015d9bfb1d08, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.409918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cd951-70a8-4978-99d1-1c0a7cdb1bf4 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.425284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f012-250a-4e34-9225-4a2bf97f77b6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.462546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.470519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.471203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.471581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.472561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.472561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:16.472877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.474661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.491441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 412/826] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:16.491441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.509177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 415/827] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:05:16 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/348efd4e6a0948afb8b0015d9bfb1d08/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:16.510180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cd951-70a8-4978-99d1-1c0a7cdb1bf4 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.691596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c3b69-76ac-43ae-96c2-de77d5a2c94d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.713542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cd951-70a8-4978-99d1-1c0a7cdb1bf4 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.730584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.744425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.745975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.746604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.747081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.748382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] RBAC: Adding query filter params (type=network) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:16.749035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.751178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.757876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 413/828] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:16.763075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.765101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.766530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.766813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.767090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.785137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.786775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:16.807998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:16.809526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:16.811433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 416/829] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:16.815737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.835344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.922264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285dbbd-3833-4dcd-bced-8f4f9b05ae20 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.976694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1780ed-8b1c-4917-b9f8-0b9b1c795af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.977260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1780ed-8b1c-4917-b9f8-0b9b1c795af6 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.977538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1780ed-8b1c-4917-b9f8-0b9b1c795af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.977806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1780ed-8b1c-4917-b9f8-0b9b1c795af6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.978523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1780ed-8b1c-4917-b9f8-0b9b1c795af6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.979883 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1780ed-8b1c-4917-b9f8-0b9b1c795af6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.985056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26736-9b5d-4a74-9f4d-0018893b3a41 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:17.047069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:17.047725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:17.048035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:17.048385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:17.049315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:17.049623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:17.051125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:17.065636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 417/830] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:17.072340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:17.092432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 414/831] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:17.153348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:17.278655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3018712-7b30-4295-b69f-b2194496e368 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:17.335273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f03b16-441b-434d-a332-bad79f09ff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:17.336163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03b16-441b-434d-a332-bad79f09ff9e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:17.336590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03b16-441b-434d-a332-bad79f09ff9e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:17.337040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03b16-441b-434d-a332-bad79f09ff9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:17.346974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f03b16-441b-434d-a332-bad79f09ff9e None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=66a82e8f2e304418adce1935fe7abcb8) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:17.346974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f03b16-441b-434d-a332-bad79f09ff9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:17.346974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f03b16-441b-434d-a332-bad79f09ff9e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:17.347378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 418/832] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:17 2022] GET /identity/v3/role_assignments?user.id=66a82e8f2e304418adce1935fe7abcb8&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:17.387223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77422bd3-a2b3-4a78-8389-d342338524fc None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:17.396718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77422bd3-a2b3-4a78-8389-d342338524fc None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:17.396718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77422bd3-a2b3-4a78-8389-d342338524fc None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:17.396718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 415/833] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:17.397013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add79630-47e7-4bb3-9da8-db7296759f9a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:17.397013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add79630-47e7-4bb3-9da8-db7296759f9a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:17.397013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add79630-47e7-4bb3-9da8-db7296759f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:17.420680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-add79630-47e7-4bb3-9da8-db7296759f9a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:17.422152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-add79630-47e7-4bb3-9da8-db7296759f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:17.511637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 419/834] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:17.541490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77422bd3-a2b3-4a78-8389-d342338524fc None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:17.680747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77422bd3-a2b3-4a78-8389-d342338524fc None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:17.693167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:17.720730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715f98-2479-4aa0-b437-22843f66c8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:17.721671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715f98-2479-4aa0-b437-22843f66c8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:17.722156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715f98-2479-4aa0-b437-22843f66c8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:17.722652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715f98-2479-4aa0-b437-22843f66c8a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:17.734602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45715f98-2479-4aa0-b437-22843f66c8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-45715f98-2479-4aa0-b437-22843f66c8a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:17.741189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:17.742423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:05:17.743522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:17.746003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 416/835] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:05:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:17.753757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add79630-47e7-4bb3-9da8-db7296759f9a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:17.780097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:17.864325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add79630-47e7-4bb3-9da8-db7296759f9a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:17.901621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:17.902255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:17.902536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:17.902819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:17.903546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:17.903854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:17.905267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:17.914575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 420/836] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:05:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:17.920370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715f98-2479-4aa0-b437-22843f66c8a2 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:18.039140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715f98-2479-4aa0-b437-22843f66c8a2 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:18.082697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:18.083417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:18.084293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:18.084553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:18.096349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:18.097980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:18.114112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:18.115167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:18.116072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:18.116072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:18.116072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:18.116072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:18.116072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 417/837] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:18.122039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:18.215443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:18.230497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ff71e-d57b-45f7-b1c8-fbdeac3848b3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:18.266133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:18.266749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:18.267028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:18.267295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:18.267981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:18.268278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:18.269680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:18.284109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 421/838] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:18.289990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:18.319886 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:18.408952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f1526-5357-45ee-a922-bca17db5241b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:18.445271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:18.445906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:18.446180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:18.446554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:18.454061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:18.455496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:18.468831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:18.469887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:18.470843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 418/839] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:05:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:18.478105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:18.604457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1104ca-1318-4ce8-8bdf-6a8bf68f0477 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:18.641890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff00551-7cee-4fb5-91fa-01ef2c3c23f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:18.642526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff00551-7cee-4fb5-91fa-01ef2c3c23f2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:18.642808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff00551-7cee-4fb5-91fa-01ef2c3c23f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:18.643092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff00551-7cee-4fb5-91fa-01ef2c3c23f2 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:18.643896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff00551-7cee-4fb5-91fa-01ef2c3c23f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:18.644203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff00551-7cee-4fb5-91fa-01ef2c3c23f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:18.645982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff00551-7cee-4fb5-91fa-01ef2c3c23f2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:18.669807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 422/840] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Aug 4 21:05:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:18.678335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:18.684639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93f1f-fd7d-48a8-aa7a-59a4404307f5 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:18.684984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93f1f-fd7d-48a8-aa7a-59a4404307f5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:18.685311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93f1f-fd7d-48a8-aa7a-59a4404307f5 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:18.686967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 423/841] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:18.696592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26192-7fb3-41f3-9564-c5c3398e517b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:18.697224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26192-7fb3-41f3-9564-c5c3398e517b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:18.697659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd26192-7fb3-41f3-9564-c5c3398e517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:18.709546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:18.723712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-2dd26192-7fb3-41f3-9564-c5c3398e517b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:18.725656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-2dd26192-7fb3-41f3-9564-c5c3398e517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:18.804814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:18.816372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 424/842] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:18.834589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8d26d-610f-4979-a590-d8f818eac15f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:18.839791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd26192-7fb3-41f3-9564-c5c3398e517b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:18.873843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444edd4-eacb-4c1e-b6ca-c694d0766a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:18.874472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444edd4-eacb-4c1e-b6ca-c694d0766a88 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:18.874767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444edd4-eacb-4c1e-b6ca-c694d0766a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:18.875084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444edd4-eacb-4c1e-b6ca-c694d0766a88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:18.950553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444edd4-eacb-4c1e-b6ca-c694d0766a88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:18.951982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444edd4-eacb-4c1e-b6ca-c694d0766a88 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:18.953715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd26192-7fb3-41f3-9564-c5c3398e517b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:18.995745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9f996-f6a7-4b9b-95d9-89d551196c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:18.996531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9f996-f6a7-4b9b-95d9-89d551196c00 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:18.996814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9f996-f6a7-4b9b-95d9-89d551196c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:18.997125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9f996-f6a7-4b9b-95d9-89d551196c00 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:18.997756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9f996-f6a7-4b9b-95d9-89d551196c00 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:18.999126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9f996-f6a7-4b9b-95d9-89d551196c00 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.001014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-42c9f996-f6a7-4b9b-95d9-89d551196c00 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:19.011679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:19.015474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:19.021080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 425/843] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:19.022131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de101c-ce36-41f0-bb0a-b1afadfea935 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.022131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de101c-ce36-41f0-bb0a-b1afadfea935 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.022131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de101c-ce36-41f0-bb0a-b1afadfea935 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.022131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 426/844] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:19.022131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de101c-ce36-41f0-bb0a-b1afadfea935 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.057702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:19.087009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 419/845] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:05:19.087009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781489-9bea-4aa1-8d27-bf8e66028b07 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.087009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781489-9bea-4aa1-8d27-bf8e66028b07 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.087009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781489-9bea-4aa1-8d27-bf8e66028b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.104792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ce781489-9bea-4aa1-8d27-bf8e66028b07 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:19.106001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ce781489-9bea-4aa1-8d27-bf8e66028b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:19.147323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de101c-ce36-41f0-bb0a-b1afadfea935 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.182334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 420/846] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:19.185110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce781489-9bea-4aa1-8d27-bf8e66028b07 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.205476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.206566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.207147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.207656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.209547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:19.210378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:19.212475 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.218190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 427/847] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:19.219015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.284763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:19.297826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce781489-9bea-4aa1-8d27-bf8e66028b07 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.309811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:19.326526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285480-ad00-42e5-9a02-adf67997e577 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.335351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.336113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.336402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.336677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.347897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:19.349627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.364733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6b2a3-a3a6-4e96-8b31-3f94d431fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.366051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b2a3-a3a6-4e96-8b31-3f94d431fe1d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.366321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b2a3-a3a6-4e96-8b31-3f94d431fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:19.366434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:19.367273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:19.368182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:19.368182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:19.368182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:19.368182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:19.369136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b2a3-a3a6-4e96-8b31-3f94d431fe1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.372521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 421/848] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:19.373202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.379601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6b2a3-a3a6-4e96-8b31-3f94d431fe1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-24a6b2a3-a3a6-4e96-8b31-3f94d431fe1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:19.388262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:19.389610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:19.390544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 428/849] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:19.392547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6b2a3-a3a6-4e96-8b31-3f94d431fe1d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.494695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf455a-d838-49b6-84a8-b03b476098cc None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.499081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6b2a3-a3a6-4e96-8b31-3f94d431fe1d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.522825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:19.536370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.536916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.537297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.537531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.537796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.538006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.538265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.538447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.539051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:19.539351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:19.539541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:19.540121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:19.540831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.541727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.557171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 422/850] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:19.557171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.557450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 429/851] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:19.562178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.603097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:19.692083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef2a3e-4009-4273-870a-e197a49f58d0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.727188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d27c73-d49a-444a-b930-1b1ecd58f467 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.742266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f835c56-4f74-43de-b34d-4a95d87825cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.743222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835c56-4f74-43de-b34d-4a95d87825cc None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.743575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835c56-4f74-43de-b34d-4a95d87825cc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.743917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835c56-4f74-43de-b34d-4a95d87825cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.751333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f835c56-4f74-43de-b34d-4a95d87825cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:19.752808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f835c56-4f74-43de-b34d-4a95d87825cc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.766067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.766680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.766954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.767222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.767926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:19.768226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-2f835c56-4f74-43de-b34d-4a95d87825cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:19.768427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:19.769522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:19.770669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:19.770669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:19.770669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:19.770669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:19.770669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:19.770669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:19.770669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:19.770669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:19.771761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.772195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 430/852] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:19.785050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 423/853] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:19.785402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba300-8902-48f8-9f00-d548874e81b1 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.785512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.785639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba300-8902-48f8-9f00-d548874e81b1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.785639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba300-8902-48f8-9f00-d548874e81b1 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.785639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 431/854] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:19.787411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba300-8902-48f8-9f00-d548874e81b1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.852623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:19.898663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:19.913811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379fc9f-652b-46bd-a89b-207f11a0d035 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.919043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba300-8902-48f8-9f00-d548874e81b1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:19.952486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b42df0-77f8-4a6c-8e22-c180e0560549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.953126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42df0-77f8-4a6c-8e22-c180e0560549 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.953404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42df0-77f8-4a6c-8e22-c180e0560549 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.953670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42df0-77f8-4a6c-8e22-c180e0560549 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.954405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42df0-77f8-4a6c-8e22-c180e0560549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:19.954707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42df0-77f8-4a6c-8e22-c180e0560549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:19.956109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42df0-77f8-4a6c-8e22-c180e0560549 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.956680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:19.957541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.957895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.958379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.969616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:19.976283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 424/855] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:19.976452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:19.976540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8fd05-f79b-4771-b64a-0110473e3523 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:19.976540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8fd05-f79b-4771-b64a-0110473e3523 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:19.976540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8fd05-f79b-4771-b64a-0110473e3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:19.991367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:19.992335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:19.993278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:19.993278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:19.993278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:19.993278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:19.993507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a6f8fd05-f79b-4771-b64a-0110473e3523 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:19.993581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 432/856] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:19.994165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:19.997674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a6f8fd05-f79b-4771-b64a-0110473e3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:20.072830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 425/857] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:20.073940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8fd05-f79b-4771-b64a-0110473e3523 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:20.095044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:20.103240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827c29-bfc9-425a-a3b6-ff00810cbc11 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:20.137833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:20.138446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:20.138723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:20.138990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:20.139772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=f412bc92d203449fb04f3d2c1194f937) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:20.140076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:20.141529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:20.148740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 433/858] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:19 2022] GET /identity/v3/role_assignments?user.id=f412bc92d203449fb04f3d2c1194f937&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:20.149741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:20.185014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:20.211514 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8fd05-f79b-4771-b64a-0110473e3523 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:20.258701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:20.260002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:20.261001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:20.261492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:20.262655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:20.263445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:20.265535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:20.284739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 426/859] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:20.285839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503bb1-ae43-4cc5-aefa-43e0b70a4d5e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:20.294187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:20.337972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:20.338635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:20.338986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:20.339331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:20.340177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:20.341525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:20.353041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:20.354047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:20.354919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 434/860] 10.222.0.93 () {56 vars in 1132 bytes} [Thu Aug 4 21:05:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:20.360803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:20.396318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:20.433570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f32bff-902a-4dd1-a1a6-82bedf6b5a0d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:20.484495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:20.485890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:20.486168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:20.486436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:20.499089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096dafe-6de9-4fdb-9319-20e73bd7965a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:20.504073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:20.506134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:20.509020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:20.523981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:20.525044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 21:05:20.526101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:20.526748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 427/861] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:20.536493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:20.542104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:20.542730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:20.543008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:20.543281 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:20.543964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:20.544257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:20.545865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:20.556973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 435/862] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:20.560100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:20.676938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:20.683569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1190bbb-5bd5-465a-a877-c67f6e63d5cd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:20.695463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c088-1255-4424-86b7-0e1d43951463 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:20.720580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:20.721631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:20.722301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:20.722848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:20.724817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:20.725435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:20.727305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:20.737022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:20.737649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:20.737925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:20.738195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:20.739021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:20.739391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:20.742070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:20.748077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 436/863] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:20.760876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 428/864] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Aug 4 21:05:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:20.762099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:20.886478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfcb5c-f881-41b7-aa4e-95da0f54a558 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:20.932508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4076f-7f16-4edd-aeac-a708ea9015a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:20.933198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4076f-7f16-4edd-aeac-a708ea9015a5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:20.933483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4076f-7f16-4edd-aeac-a708ea9015a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:20.933763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4076f-7f16-4edd-aeac-a708ea9015a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:20.960290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:21.018951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4076f-7f16-4edd-aeac-a708ea9015a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:21.021914 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4076f-7f16-4edd-aeac-a708ea9015a5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:21.142654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 437/865] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 21:05:21.149399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:21.212647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:21.260339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e538-a57e-4adb-807f-5eb4b85a0ad6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:21.297920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:21.298575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:21.298847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:21.299119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:21.312096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:21.313649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:21.330203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:21.331197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:21.332262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:21.332262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:21.332262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:21.332262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:21.332262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 429/866] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:21.338513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4076f-7f16-4edd-aeac-a708ea9015a5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:21.398398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:21.468003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4076f-7f16-4edd-aeac-a708ea9015a5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:21.509984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:21.510893 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:21.511435 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:21.511913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:21.512823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:21.513359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:21.514958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:21.530053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 438/867] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:21.536730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:21.658834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f9889-cad8-4a92-a3a6-7d8e936e56ab None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:21.673239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:21.700030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa961-49f7-44b0-97e2-e12dafe0f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:21.700858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa961-49f7-44b0-97e2-e12dafe0f448 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:21.701201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa961-49f7-44b0-97e2-e12dafe0f448 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:21.701475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa961-49f7-44b0-97e2-e12dafe0f448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:21.713911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fa961-49f7-44b0-97e2-e12dafe0f448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:21.716509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fa961-49f7-44b0-97e2-e12dafe0f448 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-8a6fa961-49f7-44b0-97e2-e12dafe0f448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:21.737968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:21.738909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:21.739838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:21.739838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:21.739838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:21.739838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:21.739838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:21.739838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:21.739838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:21.739838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:21.741383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 430/868] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:21.749551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:21.751651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d66d2-b0f3-4ad4-a04d-4a516d254071 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:21.751937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d66d2-b0f3-4ad4-a04d-4a516d254071 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:21.752212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d66d2-b0f3-4ad4-a04d-4a516d254071 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:21.753622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 431/869] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:21.759429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e984b4-fe37-484e-bc01-f8bdb2145d25 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:21.759714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e984b4-fe37-484e-bc01-f8bdb2145d25 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:21.759994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e984b4-fe37-484e-bc01-f8bdb2145d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:21.779727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-15e984b4-fe37-484e-bc01-f8bdb2145d25 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:21.781028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-15e984b4-fe37-484e-bc01-f8bdb2145d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:21.855434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 432/870] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:21.875224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4501d8-4097-4a36-96b7-eac16cb3cefc None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:21.879281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e984b4-fe37-484e-bc01-f8bdb2145d25 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:21.889638 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:21.923502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:21.924586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:21.925137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:21.925633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:21.926642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:21.927173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:21.931175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:21.952706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 439/871] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:21.960232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:22.010276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:22.015025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e984b4-fe37-484e-bc01-f8bdb2145d25 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:22.055991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1803d-bfae-4833-8e18-32fe20580564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:22.056933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1803d-bfae-4833-8e18-32fe20580564 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.057296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1803d-bfae-4833-8e18-32fe20580564 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.057693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1803d-bfae-4833-8e18-32fe20580564 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.059045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1803d-bfae-4833-8e18-32fe20580564 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:22.060074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1803d-bfae-4833-8e18-32fe20580564 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:22.094822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceef3b-bc9e-4301-b725-1f8b5fb051c7 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:22.135766 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503f74c-5a4f-4108-9689-0ee3ec930e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:22.136405 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503f74c-5a4f-4108-9689-0ee3ec930e43 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.136679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503f74c-5a4f-4108-9689-0ee3ec930e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.136984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503f74c-5a4f-4108-9689-0ee3ec930e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.137796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503f74c-5a4f-4108-9689-0ee3ec930e43 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=348efd4e6a0948afb8b0015d9bfb1d08) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:22.138109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503f74c-5a4f-4108-9689-0ee3ec930e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:22.139622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503f74c-5a4f-4108-9689-0ee3ec930e43 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:22.157243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 440/873] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:21 2022] GET /identity/v3/role_assignments?user.id=348efd4e6a0948afb8b0015d9bfb1d08&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:22.157633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 433/873] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:05:21 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:22.405284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45aee3-a61e-477e-bfbc-21681212cf48 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.405666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45aee3-a61e-477e-bfbc-21681212cf48 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.405845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45aee3-a61e-477e-bfbc-21681212cf48 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.407358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 441/874] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:22.413444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d72d-edfa-49fa-8dd0-ef98b36cf437 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.414049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d72d-edfa-49fa-8dd0-ef98b36cf437 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.414635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18d72d-edfa-49fa-8dd0-ef98b36cf437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.435579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-fb18d72d-edfa-49fa-8dd0-ef98b36cf437 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:22.437166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fb18d72d-edfa-49fa-8dd0-ef98b36cf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:22.528477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 434/875] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:22.552746 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45aee3-a61e-477e-bfbc-21681212cf48 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:22.596629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:22.674205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45aee3-a61e-477e-bfbc-21681212cf48 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:22.721939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653f774-8bfb-4f17-b674-8076f4b156b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:22.722722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f774-8bfb-4f17-b674-8076f4b156b0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.723231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f774-8bfb-4f17-b674-8076f4b156b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.723507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f774-8bfb-4f17-b674-8076f4b156b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.739082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653f774-8bfb-4f17-b674-8076f4b156b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-a653f774-8bfb-4f17-b674-8076f4b156b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:22.746600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:22.747580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:22.748419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:22.749076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 442/876] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Aug 4 21:05:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:22.756450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18d72d-edfa-49fa-8dd0-ef98b36cf437 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:22.849576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:22.870237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18d72d-edfa-49fa-8dd0-ef98b36cf437 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:22.916120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:22.917013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.917292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.917563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.918281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:22.918579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:22.919946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:22.923447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a569c-b174-4356-8b07-a515529d3c39 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.923936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a569c-b174-4356-8b07-a515529d3c39 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.924052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a569c-b174-4356-8b07-a515529d3c39 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.926193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 443/877] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:22.938517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 435/878] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Aug 4 21:05:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:22.938946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b01-ac02-4f82-91e3-edd98c8ef179 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.939505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b01-ac02-4f82-91e3-edd98c8ef179 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.939945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b01-ac02-4f82-91e3-edd98c8ef179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.944617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:22.967171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-29380b01-ac02-4f82-91e3-edd98c8ef179 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:22.969323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-29380b01-ac02-4f82-91e3-edd98c8ef179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:23.077203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 444/879] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:23.085082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ac68-ddf8-46a7-b0a9-ca1ee9a56280 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:23.100785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29380b01-ac02-4f82-91e3-edd98c8ef179 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:23.126461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:23.127538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:23.128712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:23.129302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:23.129747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:23.145046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:23.147899 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:23.156989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:23.170495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:23.172073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:23.173195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:23.173195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:23.173195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:23.173195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:23.174336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 436/880] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:23.181373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:23.219526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29380b01-ac02-4f82-91e3-edd98c8ef179 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:23.259434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0285ccd-5d77-4fc6-af3b-d648987368bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:23.260481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0285ccd-5d77-4fc6-af3b-d648987368bc None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:23.261022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0285ccd-5d77-4fc6-af3b-d648987368bc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:23.261304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0285ccd-5d77-4fc6-af3b-d648987368bc None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:23.262109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0285ccd-5d77-4fc6-af3b-d648987368bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:23.263492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0285ccd-5d77-4fc6-af3b-d648987368bc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:23.318787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccac52a-71ec-4078-b8ad-f22c7dcce003 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:23.363509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:23.364176 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:23.364462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:23.364792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:23.365823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:23.366134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:23.366490 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 445/881] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:05:23 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:23.367559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:23.392861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 437/882] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:23.399896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0285ccd-5d77-4fc6-af3b-d648987368bc None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:23.511286 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:23.535309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0285ccd-5d77-4fc6-af3b-d648987368bc None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:23.574082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:23.574731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:23.575013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:23.575289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:23.584006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:23.585659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:23.598321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:23.599838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:23.600950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 446/883] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:05:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:23.606428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:23.672586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:23.736024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa60fb-b99f-4f90-a964-5c058295d7e9 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:23.774665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:23.775305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:23.775637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:23.775912 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:23.776767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:23.777156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:23.778657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:23.798232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 438/884] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Aug 4 21:05:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:23.804590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:23.924419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd58fa7-2074-4144-ad8a-21aaac49667d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:23.964163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323d926-d30e-4e92-b725-259503b3e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:23.964789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d926-d30e-4e92-b725-259503b3e441 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:23.965202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d926-d30e-4e92-b725-259503b3e441 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:23.965477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d926-d30e-4e92-b725-259503b3e441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:23.978204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:24.048613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d926-d30e-4e92-b725-259503b3e441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:24.050017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d926-d30e-4e92-b725-259503b3e441 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:24.165210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 447/885] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:23 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:05:24.176935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:24.295425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f1f8f-55bc-4bd2-9feb-f097866f8dbd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:24.313378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:24.336464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111e72a-89a8-4ba0-a175-944a34c24a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:24.337162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111e72a-89a8-4ba0-a175-944a34c24a30 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.337440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111e72a-89a8-4ba0-a175-944a34c24a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.337707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111e72a-89a8-4ba0-a175-944a34c24a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.349794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111e72a-89a8-4ba0-a175-944a34c24a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:24.351586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111e72a-89a8-4ba0-a175-944a34c24a30 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-9111e72a-89a8-4ba0-a175-944a34c24a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:24.368460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:24.370217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:24.371218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:24.371218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:24.371218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:24.371218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:24.371218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 439/886] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:24.377526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323d926-d30e-4e92-b725-259503b3e441 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:24.405583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d099c-b635-4837-b5a2-3648c6c5276a None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.406212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d099c-b635-4837-b5a2-3648c6c5276a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.406745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d099c-b635-4837-b5a2-3648c6c5276a None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.408370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 440/887] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:24.415290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8841b0-e071-4934-af29-93c6dc340a52 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.415946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8841b0-e071-4934-af29-93c6dc340a52 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.416317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8841b0-e071-4934-af29-93c6dc340a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.433577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:24.437430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6e8841b0-e071-4934-af29-93c6dc340a52 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:24.438738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6e8841b0-e071-4934-af29-93c6dc340a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:24.511859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323d926-d30e-4e92-b725-259503b3e441 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:24.532498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 441/888] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:24.535182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a464d-4f0e-4404-afea-8d468a175fb7 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.535470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a464d-4f0e-4404-afea-8d468a175fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.535735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a464d-4f0e-4404-afea-8d468a175fb7 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.539422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 442/889] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:24.545755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2377097-dfb2-4166-af81-443249388384 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.546307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2377097-dfb2-4166-af81-443249388384 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.547036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2377097-dfb2-4166-af81-443249388384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.559932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:24.560560 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.560838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.561142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.561832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:24.562131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:24.563586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:24.568392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f2377097-dfb2-4166-af81-443249388384 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:24.569718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f2377097-dfb2-4166-af81-443249388384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:24.576059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 448/890] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:24.580710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:24.653758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 443/891] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:24.655027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2377097-dfb2-4166-af81-443249388384 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:24.699340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:24.715593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:24.718888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda775ca-7aa8-45ea-9623-15bc4bbcf70b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:24.756119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:24.756849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.757396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.757887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.759055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:24.760702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:24.770884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:24.772621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:24.774063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 449/892] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:24.774869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:24.800509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2377097-dfb2-4166-af81-443249388384 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:24.853120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:24.853672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.853948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.854214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.863290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:24.863786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:24.877727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:24.878765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 444/893] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:24.879752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:24.904306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a180559-d8a5-42bd-bc82-508a68480fa0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:24.945554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:24.946604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:24.947148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:24.947498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:24.948375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:24.950517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:24.961756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:24.962971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:24.964083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:24.968215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 450/894] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:24.968897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:24.982638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:24.995541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9a9dc-182b-46da-9e47-e6753e78b55b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:25.002821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:25.044101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:25.044724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.045115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.045433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.046124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:25.046431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:25.047926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:25.055181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 445/895] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:25.056027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:25.103037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bb291-3eed-4bcf-aba8-545b897663ae None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:25.160112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:25.166144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.166940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.167236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.168014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:25.168325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:25.169871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:25.181221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd57f-7589-49dd-a449-75a570fd099f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:25.190814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 451/896] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:25.190814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:25.229761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:25.230349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.230629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.230907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.231631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:25.231992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:25.233442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:25.238607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 446/897] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:25.239428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:25.260292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:25.307011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:25.319279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9bcea-37ab-4878-944e-4ebd28a84c7c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:25.365081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672c981-e5e5-411b-b352-b6860e756f17 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:25.369649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:25.370690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.371142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.371743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.372873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:25.373400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:25.375810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:25.392932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 452/898] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:25.392932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:25.445968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:25.446625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.446980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.447324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.448239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] RBAC: Adding query filter params (role.id=4522d797836940d19cb619ddd44d3d6e, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=f412bc92d203449fb04f3d2c1194f937) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:25.449307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:25.451016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:25.459576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 447/899] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:25 2022] GET /identity/v3/role_assignments?user.id=f412bc92d203449fb04f3d2c1194f937&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=4522d797836940d19cb619ddd44d3d6e => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:25.558292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d382f-278b-4fc7-8501-616e22c11e80 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:25.609508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0f6ef-371d-4642-8037-aba5f4b2898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:25.610152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f6ef-371d-4642-8037-aba5f4b2898a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.610510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f6ef-371d-4642-8037-aba5f4b2898a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.610789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f6ef-371d-4642-8037-aba5f4b2898a None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.611487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0f6ef-371d-4642-8037-aba5f4b2898a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:25.611794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0f6ef-371d-4642-8037-aba5f4b2898a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:25.613247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0f6ef-371d-4642-8037-aba5f4b2898a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:25.620459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 453/900] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:25.627341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:25.715228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a648-5be7-4bcd-a79b-f0352bcff987 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.715915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a648-5be7-4bcd-a79b-f0352bcff987 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.716404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a648-5be7-4bcd-a79b-f0352bcff987 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.718375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 454/901] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:25.726886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97693-7d47-479d-ba2f-b47a950df56a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.727520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97693-7d47-479d-ba2f-b47a950df56a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.728047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97693-7d47-479d-ba2f-b47a950df56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.747852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:25.751910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b3a97693-7d47-479d-ba2f-b47a950df56a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:25.753461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b3a97693-7d47-479d-ba2f-b47a950df56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:25.768120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:25.773720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12d440-3df1-4122-a9c2-daad5eee22a9 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:25.821537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:25.822433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:25.822715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:25.822984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:25.823967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] RBAC: Adding query filter params (interface=public, service_id=32dd45ead2144012961fd61cb489e28c, region_id=RegionOne) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:25.824277 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:25.826080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:25.833493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 448/902] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Aug 4 21:05:25 2022] GET /identity/v3/endpoints?service_id=32dd45ead2144012961fd61cb489e28c&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:25.840874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:25.863499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 455/903] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:25.891420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97693-7d47-479d-ba2f-b47a950df56a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:26.000563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9144c6d-946c-4bb0-a4ae-bf1c01fbd553 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:26.032102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97693-7d47-479d-ba2f-b47a950df56a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:26.052396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a57ae-d3c8-4869-9d10-34ba82dc09b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:26.053665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a57ae-d3c8-4869-9d10-34ba82dc09b6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:26.054146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a57ae-d3c8-4869-9d10-34ba82dc09b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:26.054745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a57ae-d3c8-4869-9d10-34ba82dc09b6 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:26.055645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a57ae-d3c8-4869-9d10-34ba82dc09b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:26.057110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a57ae-d3c8-4869-9d10-34ba82dc09b6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:26.064821 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 449/904] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:05:25 2022] GET /identity/v3/services => generated 1268 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:26.086462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:26.087220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:26.087372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:26.087695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:26.088327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:26.089838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:26.102509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:26.104066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:26.105715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 456/905] 10.222.0.93 () {56 vars in 1132 bytes} [Thu Aug 4 21:05:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:26.113776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a57ae-d3c8-4869-9d10-34ba82dc09b6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:26.133504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:26.299030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a57ae-d3c8-4869-9d10-34ba82dc09b6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:26.359921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:26.360956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:26.361419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:26.361891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:26.363088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:26.363621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:26.366141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:26.385581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 450/906] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:26.392198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:26.405660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:26.503044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604c7e9-6257-4bea-8f0a-53d1ce156c94 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:26.541650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:26.542540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:26.542823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:26.543164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:26.544159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:26.544465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:26.545990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:26.552068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 457/907] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:26.557898 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:26.653989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:26.692314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc17496-626b-4b8d-bed6-ccfd714c26f2 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:26.733904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8df87-666c-4e68-85a9-8127beacb178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:26.734819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8df87-666c-4e68-85a9-8127beacb178 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:26.735271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8df87-666c-4e68-85a9-8127beacb178 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:26.735730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8df87-666c-4e68-85a9-8127beacb178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:26.737077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8df87-666c-4e68-85a9-8127beacb178 None admin] RBAC: Adding query filter params (interface=public, service_id=051728e68d194730a802e42731ac09ea, region_id=RegionOne) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:26.737565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8df87-666c-4e68-85a9-8127beacb178 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:26.739474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8df87-666c-4e68-85a9-8127beacb178 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:26.747806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 451/908] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Aug 4 21:05:26 2022] GET /identity/v3/endpoints?service_id=051728e68d194730a802e42731ac09ea&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:26.753224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:26.853642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:26.881075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f97081-7d62-4d86-84d2-73c400a27e55 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:26.919377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d36118-d5bb-40ff-bfd7-cca8a674fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:26.920002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36118-d5bb-40ff-bfd7-cca8a674fecb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:26.920285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36118-d5bb-40ff-bfd7-cca8a674fecb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:26.920559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36118-d5bb-40ff-bfd7-cca8a674fecb None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:26.921257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d36118-d5bb-40ff-bfd7-cca8a674fecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:26.922634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d36118-d5bb-40ff-bfd7-cca8a674fecb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:26.930084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 458/909] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:05:26 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:27.750075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e37c5-06bf-4248-a04c-048dfe53b6fe None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:27.750624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e37c5-06bf-4248-a04c-048dfe53b6fe None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:27.750624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e37c5-06bf-4248-a04c-048dfe53b6fe None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:27.751600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b139db-1866-4e80-9ed1-b2c207ea1126 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:27.751993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b139db-1866-4e80-9ed1-b2c207ea1126 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:27.752165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b139db-1866-4e80-9ed1-b2c207ea1126 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:27.752259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 452/910] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:27.753964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 459/911] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:27.758810 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a3ed-2a82-49d0-b49a-4077d5300da6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:27.759302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a3ed-2a82-49d0-b49a-4077d5300da6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:27.759755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a3ed-2a82-49d0-b49a-4077d5300da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:27.759862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1eff-be6d-47a2-997a-cc0d41a7b677 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:27.760040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1eff-be6d-47a2-997a-cc0d41a7b677 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:27.760319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1eff-be6d-47a2-997a-cc0d41a7b677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:27.780010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-fac9a3ed-2a82-49d0-b49a-4077d5300da6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:27.780240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-745d1eff-be6d-47a2-997a-cc0d41a7b677 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:27.781256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fac9a3ed-2a82-49d0-b49a-4077d5300da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:27.781675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-745d1eff-be6d-47a2-997a-cc0d41a7b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:27.868968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 453/913] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:27.869186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 460/913] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:27.885760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9a3ed-2a82-49d0-b49a-4077d5300da6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:27.890154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1eff-be6d-47a2-997a-cc0d41a7b677 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:27.976425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:28.009363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:28.013725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1eff-be6d-47a2-997a-cc0d41a7b677 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:28.019394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9a3ed-2a82-49d0-b49a-4077d5300da6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:28.062494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7449d-10cc-45e0-88ab-1834e61e9dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:28.062708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be323-b4b1-47a4-9ca5-74208cc3c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:28.063388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be323-b4b1-47a4-9ca5-74208cc3c73e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:28.063667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be323-b4b1-47a4-9ca5-74208cc3c73e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:28.063944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be323-b4b1-47a4-9ca5-74208cc3c73e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:28.064279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7449d-10cc-45e0-88ab-1834e61e9dbe None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:28.064755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7449d-10cc-45e0-88ab-1834e61e9dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:28.065266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7449d-10cc-45e0-88ab-1834e61e9dbe None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:28.066486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7449d-10cc-45e0-88ab-1834e61e9dbe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:28.069171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7449d-10cc-45e0-88ab-1834e61e9dbe None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:28.078426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2be323-b4b1-47a4-9ca5-74208cc3c73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-be2be323-b4b1-47a4-9ca5-74208cc3c73e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:28.084648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:28.085693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:28.086572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:28.089231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 454/914] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Aug 4 21:05:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:28.092082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be323-b4b1-47a4-9ca5-74208cc3c73e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:28.157216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 461/915] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:05:27 2022] POST /identity/v3/services => generated 241 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:28.234294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be323-b4b1-47a4-9ca5-74208cc3c73e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:28.269510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:28.290390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2150b-9f2a-4e10-8c0d-1903b08ed36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:28.291398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2150b-9f2a-4e10-8c0d-1903b08ed36b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:28.292168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2150b-9f2a-4e10-8c0d-1903b08ed36b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:28.292669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2150b-9f2a-4e10-8c0d-1903b08ed36b None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:28.293944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2150b-9f2a-4e10-8c0d-1903b08ed36b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:28.294483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2150b-9f2a-4e10-8c0d-1903b08ed36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:28.296097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2150b-9f2a-4e10-8c0d-1903b08ed36b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:28.312038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 455/916] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Aug 4 21:05:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:28.313860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7449d-10cc-45e0-88ab-1834e61e9dbe None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:28.440189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7449d-10cc-45e0-88ab-1834e61e9dbe None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:28.442952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f233d-3d9f-4336-abf8-fc6fa5ef6bea None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:28.443343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f233d-3d9f-4336-abf8-fc6fa5ef6bea None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:28.443792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f233d-3d9f-4336-abf8-fc6fa5ef6bea None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:28.445393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 456/917] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:28.454649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2efe1-00a8-4961-80a1-b375d8267dfe None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:28.455157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2efe1-00a8-4961-80a1-b375d8267dfe None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:28.455620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2efe1-00a8-4961-80a1-b375d8267dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:28.538191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:28.541924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7fe2efe1-00a8-4961-80a1-b375d8267dfe None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:28.544052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7fe2efe1-00a8-4961-80a1-b375d8267dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:28.574653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:28.575744 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:28.576235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:28.576719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:28.607365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:28.620824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:28.646661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:28.647642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:28.648570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:28.648570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:28.648570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:28.648570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:28.654047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 462/918] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:28.660683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:28.769166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 457/919] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:28.791008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2efe1-00a8-4961-80a1-b375d8267dfe None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:28.836746 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effb24a-fe02-4147-8fb6-2c36ad13686a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:28.890354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:28.891757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:28.894464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:28.896309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:28.897447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:28.897957 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:28.899555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:28.920968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 463/920] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:28.924434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:28.941717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2efe1-00a8-4961-80a1-b375d8267dfe None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:28.959107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:28.981674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:28.982521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:28.982655 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:28.982971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:28.983702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:28.985233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:28.999538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:29.000626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 21:05:29.001610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:29.002806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 458/921] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:29.007488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:29.073822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:29.161241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6254903-0ff9-4c7b-8b37-1ab7cea8ee3d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:29.167767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476f79d-3beb-4114-9ab4-eabda1e41925 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:29.210210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3005f3-cbab-485e-bfc8-7874184c70ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:29.211497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3005f3-cbab-485e-bfc8-7874184c70ad None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.211917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3005f3-cbab-485e-bfc8-7874184c70ad None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.212370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3005f3-cbab-485e-bfc8-7874184c70ad None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.213168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3005f3-cbab-485e-bfc8-7874184c70ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:29.213563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3005f3-cbab-485e-bfc8-7874184c70ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:29.215020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3005f3-cbab-485e-bfc8-7874184c70ad None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:29.215873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb9b3-8553-4057-922d-ea515cd2d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:29.216547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb9b3-8553-4057-922d-ea515cd2d90a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.216820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb9b3-8553-4057-922d-ea515cd2d90a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.217124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb9b3-8553-4057-922d-ea515cd2d90a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.220332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 459/922] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:29.221828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7545-fc7c-4dca-8d2f-cbf48dd9ceda None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.222337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7545-fc7c-4dca-8d2f-cbf48dd9ceda None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.222800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7545-fc7c-4dca-8d2f-cbf48dd9ceda None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.225168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 460/923] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:29.226063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cb9b3-8553-4057-922d-ea515cd2d90a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:29.226822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7545-fc7c-4dca-8d2f-cbf48dd9ceda None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:29.227598 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cb9b3-8553-4057-922d-ea515cd2d90a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-6b6cb9b3-8553-4057-922d-ea515cd2d90a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:29.244509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:29.245586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:29.246524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 464/924] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:05:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:29.247663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152df11-abaf-4ff2-98e1-d78d40363e35 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.247663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152df11-abaf-4ff2-98e1-d78d40363e35 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.247663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152df11-abaf-4ff2-98e1-d78d40363e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.265977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3152df11-abaf-4ff2-98e1-d78d40363e35 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:29.267189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3152df11-abaf-4ff2-98e1-d78d40363e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:29.282384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:29.345726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7545-fc7c-4dca-8d2f-cbf48dd9ceda None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:29.355381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 465/925] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:29.355381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152df11-abaf-4ff2-98e1-d78d40363e35 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:29.393256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:29.414910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:29.415945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.416426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.417200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.418390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:29.418920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:29.421428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:29.432534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 461/926] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Aug 4 21:05:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:29.432534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:29.507912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152df11-abaf-4ff2-98e1-d78d40363e35 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:29.553249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cef69d-3a7c-471c-9eda-c31b07ee8f63 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:29.553600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:29.554168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.554500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.554807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.555602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:29.555902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:29.557389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:29.565136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:29.576689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 466/927] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Aug 4 21:05:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:29.577658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:29.617188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:29.617753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.618030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.618296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.618927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:29.620289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:29.629600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:29.632272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:29.633568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 462/928] 10.222.0.93 () {56 vars in 1132 bytes} [Thu Aug 4 21:05:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:29.634919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:29.696629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:29.710613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827cbd-2c24-4165-9ab1-68014c898ae9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:29.749612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87658c2-76e4-4075-903b-250cd7101ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:29.750222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87658c2-76e4-4075-903b-250cd7101ec0 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.750503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87658c2-76e4-4075-903b-250cd7101ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.750773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87658c2-76e4-4075-903b-250cd7101ec0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.751469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87658c2-76e4-4075-903b-250cd7101ec0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:29.752830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87658c2-76e4-4075-903b-250cd7101ec0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:29.753047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0683d-46f5-49ff-9c3e-b5a32c6bf667 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:29.790998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:29.792001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:29.792173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:29.792442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:29.804328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:29.805791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:29.822858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:29.823903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:29.830322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:29.830322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:29.830322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:29.830322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:29.830322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 463/929] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:29.830322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:29.841082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 467/930] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:29.841082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87658c2-76e4-4075-903b-250cd7101ec0 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:29.860711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:29.998320 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87658c2-76e4-4075-903b-250cd7101ec0 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.000308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48074e-4466-4a93-860d-94b79f45d446 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.046593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.047633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.047861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.048343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.048531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.048719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.048875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.049380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.049577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:30.049878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.050691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:30.051193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.051360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.053447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.057481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 464/931] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:30.063166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.064497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:30.074661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 468/932] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:30.077807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.193385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e93a2-edcf-4239-a6a3-f957cc32db40 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.205401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:30.223726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7256-5bde-4dbe-8190-505ef8f37c60 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.240166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.241353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.242072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.243056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.244433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:30.244966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.247426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.255731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 465/933] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:30.261400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.272843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.273879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.274404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.274897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.282669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.284516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:30.297740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:30.298691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:30.299617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:30.299617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:30.299617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:30.299617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:30.299617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:30.299617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:30.299617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:30.299617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:30.302192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 469/934] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:30.310160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.392566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:30.393967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4493-e684-4d9b-ab35-1b86a611fa2f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.437454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e07a91-e90e-492c-abba-584d22cb72aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.438083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e07a91-e90e-492c-abba-584d22cb72aa None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.438357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e07a91-e90e-492c-abba-584d22cb72aa None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.438623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e07a91-e90e-492c-abba-584d22cb72aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.439341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e07a91-e90e-492c-abba-584d22cb72aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.440700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e07a91-e90e-492c-abba-584d22cb72aa None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.453409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0377-0542-44c8-a4b4-9c7bb449e248 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.501396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f4145-5d14-401a-9657-9abfece5ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.502027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4145-5d14-401a-9657-9abfece5ab8d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.502303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4145-5d14-401a-9657-9abfece5ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.503337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4145-5d14-401a-9657-9abfece5ab8d None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.503337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f4145-5d14-401a-9657-9abfece5ab8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:30.503737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f4145-5d14-401a-9657-9abfece5ab8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.505278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f4145-5d14-401a-9657-9abfece5ab8d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.522711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 470/935] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:30.522711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee82f-81e3-408f-95a6-543c0394e397 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.522711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee82f-81e3-408f-95a6-543c0394e397 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.523067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee82f-81e3-408f-95a6-543c0394e397 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.524240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 471/936] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:30.527033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee82f-81e3-408f-95a6-543c0394e397 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.549099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 466/937] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:30.550346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45915e-3d67-4df9-b1b2-b7222dea99a7 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.550632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45915e-3d67-4df9-b1b2-b7222dea99a7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.550926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45915e-3d67-4df9-b1b2-b7222dea99a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.568079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:30.574692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-bd45915e-3d67-4df9-b1b2-b7222dea99a7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:30.576036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bd45915e-3d67-4df9-b1b2-b7222dea99a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:30.679878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 467/938] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:30.690728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee82f-81e3-408f-95a6-543c0394e397 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.706037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45915e-3d67-4df9-b1b2-b7222dea99a7 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.720930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:30.743570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5ff8-17cd-4bdc-b3d4-1b25e32a84ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.744820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5ff8-17cd-4bdc-b3d4-1b25e32a84ae None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.745770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5ff8-17cd-4bdc-b3d4-1b25e32a84ae None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.746261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5ff8-17cd-4bdc-b3d4-1b25e32a84ae None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/f412bc92d203449fb04f3d2c1194f937/roles/4522d797836940d19cb619ddd44d3d6e` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.749632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5ff8-17cd-4bdc-b3d4-1b25e32a84ae None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=f412bc92d203449fb04f3d2c1194f937, role_id=4522d797836940d19cb619ddd44d3d6e)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.752404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5ff8-17cd-4bdc-b3d4-1b25e32a84ae None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.825005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 472/939] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:05:30 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/f412bc92d203449fb04f3d2c1194f937/roles/4522d797836940d19cb619ddd44d3d6e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:30.838447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45915e-3d67-4df9-b1b2-b7222dea99a7 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.883243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:30.892472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.893687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.894242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.894716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.895595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.897437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:30.908104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:30.911198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:30.913262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:30.917422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 468/940] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:30.923937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5ff8-17cd-4bdc-b3d4-1b25e32a84ae None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.050823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5ff8-17cd-4bdc-b3d4-1b25e32a84ae None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.090122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.091127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.091613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.092092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.093005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:31.093529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.095168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.102608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 473/941] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:31.108725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.223346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d5fd-643b-4225-9cdc-a5c0a39b2406 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.261127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.262115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.262605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.263079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.263947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:31.264474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.266057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.272578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 469/942] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:31.278694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.330561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:31.392689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73422f7-c85a-4f78-8408-66504743270b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.446920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280557d-625b-4aed-a89a-9808f1d214cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.448265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280557d-625b-4aed-a89a-9808f1d214cc None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.448981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280557d-625b-4aed-a89a-9808f1d214cc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.449649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280557d-625b-4aed-a89a-9808f1d214cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.451200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280557d-625b-4aed-a89a-9808f1d214cc None admin] RBAC: Adding query filter params (interface=public, service_id=a6aec130838945feaccf1504712b7dab, region_id=RegionOne) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:31.451968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280557d-625b-4aed-a89a-9808f1d214cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.454667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280557d-625b-4aed-a89a-9808f1d214cc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.465807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 474/943] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Aug 4 21:05:31 2022] GET /identity/v3/endpoints?service_id=a6aec130838945feaccf1504712b7dab&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:31.476949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.539588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:31.584842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82af7a-82a1-4e59-adc1-8faab1a4c20b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.622447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fcaf4-2e49-4eef-b480-32d5287f8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.623072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fcaf4-2e49-4eef-b480-32d5287f8f91 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.623349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fcaf4-2e49-4eef-b480-32d5287f8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.623622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fcaf4-2e49-4eef-b480-32d5287f8f91 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.624271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fcaf4-2e49-4eef-b480-32d5287f8f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.625735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fcaf4-2e49-4eef-b480-32d5287f8f91 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.633140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 470/944] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:05:31 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:32.177563 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9c866-2424-4ca4-9821-08677c61d16d None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.178119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9c866-2424-4ca4-9821-08677c61d16d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.178400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9c866-2424-4ca4-9821-08677c61d16d None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.180063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 475/945] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:32.185608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6409aa-d2a2-48e5-ac40-7abc8e7aa489 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.186328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6409aa-d2a2-48e5-ac40-7abc8e7aa489 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.186328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6409aa-d2a2-48e5-ac40-7abc8e7aa489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.205765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-5c6409aa-d2a2-48e5-ac40-7abc8e7aa489 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:32.207323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5c6409aa-d2a2-48e5-ac40-7abc8e7aa489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:32.287691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 471/946] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:32.311448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9c866-2424-4ca4-9821-08677c61d16d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.438846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9c866-2424-4ca4-9821-08677c61d16d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.450232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:32.479032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.480022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.480531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.481042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.481955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.483600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.486502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING keystone.server.flask.common [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 21:05:32.524239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.sql.core [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 21:05:32.524239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 21:05:32.524239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [parameters: {'id': 'f2f01fc297fb43e984fe42dc4f72d514', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 21:05:32.524239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80841) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2f01fc297fb43e984fe42dc4f72d514.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2f01fc297fb43e984fe42dc4f72d514. Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application conn.query(q) Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 21:05:32.544548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application result.read() Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 21:05:32.545595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application next(self.gen) Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application yield resource Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application next(self.gen) Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise self.value Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application session.commit() Aug 04 21:05:32.546818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self.session.flush() Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application compat.raise_( Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 21:05:32.547911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 21:05:32.549063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application conn.query(q) Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application result.read() Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 21:05:32.549937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [parameters: {'id': 'f2f01fc297fb43e984fe42dc4f72d514', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:32.550882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:32.552633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f2f01fc297fb43e984fe42dc4f72d514. Aug 04 21:05:32.553940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:32.557608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 476/947] 10.222.0.93 () {60 vars in 1140 bytes} [Thu Aug 4 21:05:32 2022] POST /identity/v3/projects => generated 262 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:32.563923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6409aa-d2a2-48e5-ac40-7abc8e7aa489 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.650864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:32.713453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6409aa-d2a2-48e5-ac40-7abc8e7aa489 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.756472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bb2cf-00de-4f27-bdca-ade052a1d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.757398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bb2cf-00de-4f27-bdca-ade052a1d7fb None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.757676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bb2cf-00de-4f27-bdca-ade052a1d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.757947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bb2cf-00de-4f27-bdca-ade052a1d7fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.765733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bb2cf-00de-4f27-bdca-ade052a1d7fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.767180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bb2cf-00de-4f27-bdca-ade052a1d7fb None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-f84bb2cf-00de-4f27-bdca-ade052a1d7fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:32.780383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:32.781417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:32.782304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 472/948] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:32.788142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.814086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8479-367d-4e61-95d9-ad56144198c9 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.814364 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8479-367d-4e61-95d9-ad56144198c9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.814633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8479-367d-4e61-95d9-ad56144198c9 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.816130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 473/949] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:32.822200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47b82c-14b7-4955-b9ff-eb8f2713798a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.822491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47b82c-14b7-4955-b9ff-eb8f2713798a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.822749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47b82c-14b7-4955-b9ff-eb8f2713798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.843131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-bb47b82c-14b7-4955-b9ff-eb8f2713798a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:32.844777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bb47b82c-14b7-4955-b9ff-eb8f2713798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:32.923930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58993e8d-0527-4bc1-832c-e7968dfa4212 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.940592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 474/950] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:32.969906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.970450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.970727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.970999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.971718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:32.972017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.973901 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.979420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47b82c-14b7-4955-b9ff-eb8f2713798a None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.998571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 477/951] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:33.066110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:33.161388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47b82c-14b7-4955-b9ff-eb8f2713798a None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.203259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60a9b6-26e7-4771-8433-c7f03c914f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.204773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a9b6-26e7-4771-8433-c7f03c914f72 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.205296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a9b6-26e7-4771-8433-c7f03c914f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.205768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60a9b6-26e7-4771-8433-c7f03c914f72 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.206626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60a9b6-26e7-4771-8433-c7f03c914f72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.208035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60a9b6-26e7-4771-8433-c7f03c914f72 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-0d60a9b6-26e7-4771-8433-c7f03c914f72 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:33.219837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:33.221056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:33.221949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 475/952] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:33.230042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.260651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:33.290096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750a0c-afae-422a-a128-b4f35d408896 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.290299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750a0c-afae-422a-a128-b4f35d408896 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.290938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750a0c-afae-422a-a128-b4f35d408896 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.292705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 476/953] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:33.298737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61aef1-1e68-4819-a6a1-02fd6424837c None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.299219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61aef1-1e68-4819-a6a1-02fd6424837c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.299693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61aef1-1e68-4819-a6a1-02fd6424837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.324192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4f61aef1-1e68-4819-a6a1-02fd6424837c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:33.325639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4f61aef1-1e68-4819-a6a1-02fd6424837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.355589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40fe53-09b5-46e0-9025-51d0bb58356e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.397597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.398411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.398790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.399169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.400105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:33.400491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.402207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.408089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 478/954] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:33.414024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 477/955] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:33.417935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.439648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61aef1-1e68-4819-a6a1-02fd6424837c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.495001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:33.551274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:33.569450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bd4da-d0eb-4a50-aad7-dc8d1297c147 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.570417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61aef1-1e68-4819-a6a1-02fd6424837c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.615828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.616826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.617361 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.617841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.618762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:33.619273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.621377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.623453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aa87-6455-44c3-8531-64bcf227c1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.624193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aa87-6455-44c3-8531-64bcf227c1ea None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.625001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aa87-6455-44c3-8531-64bcf227c1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.625350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aa87-6455-44c3-8531-64bcf227c1ea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.628266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 479/956] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:33.643103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34aa87-6455-44c3-8531-64bcf227c1ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-7a34aa87-6455-44c3-8531-64bcf227c1ea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:33.650213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:33.651305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:33.652288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 478/957] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Aug 4 21:05:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:33.659792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.788480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e559a-3078-4061-ae94-e8847e76899e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.830964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09b084-022b-4f42-815d-38e2e8bd50c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.831985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b084-022b-4f42-815d-38e2e8bd50c6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.832523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b084-022b-4f42-815d-38e2e8bd50c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.833100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b084-022b-4f42-815d-38e2e8bd50c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.834240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09b084-022b-4f42-815d-38e2e8bd50c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:33.834813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09b084-022b-4f42-815d-38e2e8bd50c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.836199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09b084-022b-4f42-815d-38e2e8bd50c6 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.845770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 480/958] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Aug 4 21:05:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:33.852279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aa87-6455-44c3-8531-64bcf227c1ea None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.963234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eabb9-e552-4b48-b470-d1377b718957 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.963561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eabb9-e552-4b48-b470-d1377b718957 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.963798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eabb9-e552-4b48-b470-d1377b718957 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.965455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 481/959] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:33.965812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aa87-6455-44c3-8531-64bcf227c1ea None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.970765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f3e1-4d9f-4d2b-aa2c-43f12f080cfa None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.971038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f3e1-4d9f-4d2b-aa2c-43f12f080cfa None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.971318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f3e1-4d9f-4d2b-aa2c-43f12f080cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.977237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:33.992135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-bb48f3e1-4d9f-4d2b-aa2c-43f12f080cfa None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:33.993856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bb48f3e1-4d9f-4d2b-aa2c-43f12f080cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:34.006250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.021633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.022729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.023567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.024019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.038947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.040998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:34.060636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:34.061687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:34.062582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:34.062582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:34.062582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:34.062582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:34.065818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 479/960] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:34.076513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.117244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 482/961] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:34.151181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f3e1-4d9f-4d2b-aa2c-43f12f080cfa None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.188934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456300b2-7e67-417b-9a1c-457602e9e11b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.228272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.228934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.229306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.229588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.230286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:34.230704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.232084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.246154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 480/962] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:34.252073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.267638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.323308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f3e1-4d9f-4d2b-aa2c-43f12f080cfa None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.367445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.368193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.368541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.368899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.369611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.371218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:34.382566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:34.383640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:34.384468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 483/963] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:34.390253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.391870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe355ad7-283c-4183-9bed-b8c8c8cd8f81 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.407585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.453779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.457547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.457863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.458556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.470303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.473336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:34.496000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:34.497768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 481/964] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:34.504820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.557145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29072ee-2bba-4d77-aa71-699f965d540c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.595319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.597626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.598544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.599572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.600120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.601135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:34.601670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.603478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.609460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 484/965] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:34.616305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.634645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81045-a42f-4517-ab6f-cf3b5b732590 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.682822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.684109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.684581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.685068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.686209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:34.686936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.688608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.708432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.716984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 482/966] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:34.720746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.754282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22079297-faf7-4f54-b342-e17c6c6bfb40 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.802229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.802229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.802693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.802999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.803535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:34.803887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.805618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.814147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 485/967] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:34.820314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.872823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527082f8-8f9e-4e46-80ee-af995d50a1b3 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.905192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.914287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba8825-4cb2-42f1-b0cf-2e74abfa66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.914913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8825-4cb2-42f1-b0cf-2e74abfa66d6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.924252 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8825-4cb2-42f1-b0cf-2e74abfa66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.924252 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8825-4cb2-42f1-b0cf-2e74abfa66d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.956586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f62b6-685e-4d2b-8e8c-5af94ebe4a83 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.996581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba8825-4cb2-42f1-b0cf-2e74abfa66d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.998184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba8825-4cb2-42f1-b0cf-2e74abfa66d6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.001585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7566-958c-497d-84e7-cb63f860b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.001755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7566-958c-497d-84e7-cb63f860b91a None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.002025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7566-958c-497d-84e7-cb63f860b91a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.002292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7566-958c-497d-84e7-cb63f860b91a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.003008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a7566-958c-497d-84e7-cb63f860b91a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.004356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a7566-958c-497d-84e7-cb63f860b91a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.010770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:35.111276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 483/968] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:05:35.117210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba8825-4cb2-42f1-b0cf-2e74abfa66d6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.140992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 486/969] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:35.157967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:35.241858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba8825-4cb2-42f1-b0cf-2e74abfa66d6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.289679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e02a2-6420-46b3-92a3-dfc2f6fb9068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.290328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e02a2-6420-46b3-92a3-dfc2f6fb9068 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.290601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e02a2-6420-46b3-92a3-dfc2f6fb9068 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.290870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e02a2-6420-46b3-92a3-dfc2f6fb9068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.303794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e02a2-6420-46b3-92a3-dfc2f6fb9068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.305311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e02a2-6420-46b3-92a3-dfc2f6fb9068 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-203e02a2-6420-46b3-92a3-dfc2f6fb9068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:35.322819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:35.326323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:35.327299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:35.327299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:35.327299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:35.327299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:35.327299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 484/970] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:35.330246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7566-958c-497d-84e7-cb63f860b91a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.433278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d923cca-9728-4adc-a70c-fc44a5284fd3 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.433638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d923cca-9728-4adc-a70c-fc44a5284fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.434006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d923cca-9728-4adc-a70c-fc44a5284fd3 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.435744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 485/971] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:35.440716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7feae4-e138-47ac-a350-939f0763e81c None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.441113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7feae4-e138-47ac-a350-939f0763e81c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.441478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7feae4-e138-47ac-a350-939f0763e81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.446363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7566-958c-497d-84e7-cb63f860b91a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.461641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ff7feae4-e138-47ac-a350-939f0763e81c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:35.462976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ff7feae4-e138-47ac-a350-939f0763e81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:35.484964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.485591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.485867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.486137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.486949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:35.487248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.488635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.503219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 487/972] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:35.509450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.551674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 486/973] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:35.575321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:35.583537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7feae4-e138-47ac-a350-939f0763e81c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.594270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:35.629596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd970-d474-4263-a65f-2a8bff26d868 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.670669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.671316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.671592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.671912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.680642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.682204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:35.696603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:35.697758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:35.698700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:35.698700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:35.698700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:35.698700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:35.698700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:35.698700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:35.698700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:35.698700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:35.702565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 488/974] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:35.703831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.724494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7feae4-e138-47ac-a350-939f0763e81c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.776094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.777040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.777492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.778166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.779586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.781471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.785494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING keystone.server.flask.common [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 21:05:35.815791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43cac8-3ec8-4e00-8822-46c77628cf5d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.832718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:35.857252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00c741-cc32-4d08-9981-c4330709c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.857870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00c741-cc32-4d08-9981-c4330709c902 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.858148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00c741-cc32-4d08-9981-c4330709c902 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.858418 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00c741-cc32-4d08-9981-c4330709c902 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.859156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00c741-cc32-4d08-9981-c4330709c902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:35.859460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00c741-cc32-4d08-9981-c4330709c902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.860925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00c741-cc32-4d08-9981-c4330709c902 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.867413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.sql.core [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 21:05:35.867413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 21:05:35.867413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [parameters: {'user_id': 'e952e79dc718423997cb594d1be7ce01', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 21:05:35.867413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80840) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 21:05:35.877129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 489/975] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:35.877129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3a64e-1b64-4112-b8a1-6c5f52baec26 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.877129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3a64e-1b64-4112-b8a1-6c5f52baec26 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.877129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3a64e-1b64-4112-b8a1-6c5f52baec26 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application conn.query(q) Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result.read() Aug 04 21:05:35.877579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 21:05:35.880307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application next(self.gen) Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application yield resource Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application next(self.gen) Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise self.value Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application session.commit() Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 21:05:35.881485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.session.flush() Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application compat.raise_( Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 21:05:35.883431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 21:05:35.885321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application conn.query(q) Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application result.read() Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 21:05:35.887319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e952e79dc718423997cb594d1be7ce01', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:35.890538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 21:05:35.892385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 21:05:35.894411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 21:05:35.894411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 21:05:35.894411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 21:05:35.894411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 21:05:35.894411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 21:05:35.894411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:35.895191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 490/976] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:35.895191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8754d-1b83-469b-9690-81b98f22ae57 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.895191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8754d-1b83-469b-9690-81b98f22ae57 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.895191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8754d-1b83-469b-9690-81b98f22ae57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.896157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 487/977] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Aug 4 21:05:35 2022] POST /identity/v3/users => generated 160 bytes in 300 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:35.896157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.905378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b6e8754d-1b83-469b-9690-81b98f22ae57 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:35.906759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b6e8754d-1b83-469b-9690-81b98f22ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:35.966576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:35.983990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 491/978] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:35.984826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8754d-1b83-469b-9690-81b98f22ae57 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:36.015897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070832f-ae7f-4c8e-b388-d40811e7b961 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:36.054299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:36.055059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:36.055437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:36.055821 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:36.056697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] RBAC: Adding query filter params (role.id=4522d797836940d19cb619ddd44d3d6e, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=f412bc92d203449fb04f3d2c1194f937) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:36.057130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:36.058849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:36.068545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 488/979] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/role_assignments?user.id=f412bc92d203449fb04f3d2c1194f937&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=4522d797836940d19cb619ddd44d3d6e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:36.069540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:36.117112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8754d-1b83-469b-9690-81b98f22ae57 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:36.119499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:36.172671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:36.173438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:36.173785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:36.174385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:36.185564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:36.188139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:36.204652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:36.205735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:36.207338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 492/980] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:36.216760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:36.227795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e73c-4837-4442-83ad-b573e09e8aba None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:36.269939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:36.276563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0323bc-c9fb-4de5-8349-753d94f459b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:36.277307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0323bc-c9fb-4de5-8349-753d94f459b7 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:36.277552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0323bc-c9fb-4de5-8349-753d94f459b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:36.277807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0323bc-c9fb-4de5-8349-753d94f459b7 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:36.279386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0323bc-c9fb-4de5-8349-753d94f459b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:36.279863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0323bc-c9fb-4de5-8349-753d94f459b7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:36.335056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59784439-7037-4edb-aa33-726ad745c327 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:36.378686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab7bb-6fe0-4162-89df-6e8b86730776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:36.379345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab7bb-6fe0-4162-89df-6e8b86730776 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:36.379677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab7bb-6fe0-4162-89df-6e8b86730776 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:36.380400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 489/981] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:05:36 2022] POST /identity/v3/services => generated 242 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:36.380520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab7bb-6fe0-4162-89df-6e8b86730776 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:36.387719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab7bb-6fe0-4162-89df-6e8b86730776 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:36.387719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab7bb-6fe0-4162-89df-6e8b86730776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:36.387719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab7bb-6fe0-4162-89df-6e8b86730776 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:36.426700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 493/982] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Aug 4 21:05:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:37.338586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420891-9094-4c15-a8f7-1b6166e68841 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:37.339121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420891-9094-4c15-a8f7-1b6166e68841 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:37.339231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420891-9094-4c15-a8f7-1b6166e68841 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:37.340610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 490/983] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:37.346527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465e68-7170-4815-991b-075557ab241e None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:37.347057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465e68-7170-4815-991b-075557ab241e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:37.347057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465e68-7170-4815-991b-075557ab241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:37.367237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-56465e68-7170-4815-991b-075557ab241e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:37.368439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-56465e68-7170-4815-991b-075557ab241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:37.386034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:37.464992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 494/984] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:37.496344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420891-9094-4c15-a8f7-1b6166e68841 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:37.618466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420891-9094-4c15-a8f7-1b6166e68841 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:37.656082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:37.656720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:37.657039 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:37.657311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:37.657933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:37.659303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:37.670237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:37.671259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:37.672085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 491/985] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:37.678274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56465e68-7170-4815-991b-075557ab241e None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:37.791114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56465e68-7170-4815-991b-075557ab241e None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:37.829768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:37.830398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:37.830708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:37.831008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:37.831695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:37.832023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:37.834461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:37.842168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 495/986] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:37.846620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:37.906964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:37.955457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bd406-23d9-4343-9f97-b428ff7d0d52 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:38.007390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:38.008016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.008288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.008563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.009261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:38.009563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:38.010969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:38.016480 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 492/987] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:38.022890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:38.042502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:38.156030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392fa93-5829-4401-b6ee-2f43629233f1 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:38.193995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d1ae3-5e25-4286-890e-8b0bf38617c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:38.194537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1ae3-5e25-4286-890e-8b0bf38617c9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.194815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1ae3-5e25-4286-890e-8b0bf38617c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.195085 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1ae3-5e25-4286-890e-8b0bf38617c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.195847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1ae3-5e25-4286-890e-8b0bf38617c9 None admin] RBAC: Adding query filter params (interface=admin, service_id=a6aec130838945feaccf1504712b7dab, region_id=RegionOne) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:38.196156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1ae3-5e25-4286-890e-8b0bf38617c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:38.197563 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1ae3-5e25-4286-890e-8b0bf38617c9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:38.207617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 496/988] 10.222.0.93 () {56 vars in 1249 bytes} [Thu Aug 4 21:05:38 2022] GET /identity/v3/endpoints?service_id=a6aec130838945feaccf1504712b7dab&interface=admin®ion_id=RegionOne => generated 193 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:38.209679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:38.292340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b566e8-f5f7-44fd-bc7c-7df035803ed0 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.292623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b566e8-f5f7-44fd-bc7c-7df035803ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.292911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b566e8-f5f7-44fd-bc7c-7df035803ed0 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.294282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 497/989] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:38.299233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ff75-7976-49e6-86b3-3ba614fbdd4f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.299515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ff75-7976-49e6-86b3-3ba614fbdd4f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.299788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ff75-7976-49e6-86b3-3ba614fbdd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.323687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-cf46ff75-7976-49e6-86b3-3ba614fbdd4f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:38.326732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cf46ff75-7976-49e6-86b3-3ba614fbdd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:38.327702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3780a-3691-4edd-971c-c4474a5bde00 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:38.349090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:38.366693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974d1ce-bf69-4327-a7e9-f387061c2a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:38.367324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974d1ce-bf69-4327-a7e9-f387061c2a30 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.367606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974d1ce-bf69-4327-a7e9-f387061c2a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.367924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974d1ce-bf69-4327-a7e9-f387061c2a30 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.368535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974d1ce-bf69-4327-a7e9-f387061c2a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:38.369959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974d1ce-bf69-4327-a7e9-f387061c2a30 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:38.376934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 493/990] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:05:38 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:38.422111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 498/991] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:38.446278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974d1ce-bf69-4327-a7e9-f387061c2a30 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:38.523003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c226a75-d64a-4c5f-b273-2bdec0b8d18a None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.523282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c226a75-d64a-4c5f-b273-2bdec0b8d18a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.523544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c226a75-d64a-4c5f-b273-2bdec0b8d18a None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.524940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 499/992] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:38.530370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb6d0-b3dd-4c56-8570-7b22a434e80b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.530652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb6d0-b3dd-4c56-8570-7b22a434e80b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.530925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb6d0-b3dd-4c56-8570-7b22a434e80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.539873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:38.553486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-79ecb6d0-b3dd-4c56-8570-7b22a434e80b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:38.554737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-79ecb6d0-b3dd-4c56-8570-7b22a434e80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:38.595559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974d1ce-bf69-4327-a7e9-f387061c2a30 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:38.634129 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:38.634850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.635044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.635317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.635938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:38.637356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:38.647457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:38.648510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:38.649421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 494/993] 10.222.0.93 () {56 vars in 1105 bytes} [Thu Aug 4 21:05:38 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:38.654657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:38.656164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 500/994] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:38.682276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecb6d0-b3dd-4c56-8570-7b22a434e80b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:38.713465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:38.781842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749350-5625-4d94-b748-c3343ddb8db9 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:38.804837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecb6d0-b3dd-4c56-8570-7b22a434e80b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:38.820603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:38.821267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.821552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.821825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.822501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] RBAC: Adding query filter params (name=image) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:38.822804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:38.824164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:38.829747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 495/995] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:38.835447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:38.848798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:38.849536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:38.849824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:38.850104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:38.850737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:38.852108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:38.854047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:38.862180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:38.865650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:38.866671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 501/996] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:38.870039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:38.987974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abbff5-00f2-4830-ab48-6fd104af677b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:39.002391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:39.016131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bfb91-ea83-40f6-9a04-90e778373903 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:39.026592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:39.027641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:39.027641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:39.029751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:39.029751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] RBAC: Adding query filter params (type=image) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:39.029751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:39.031376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:39.036109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 496/997] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:39.057412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:39.058058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:39.058339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:39.058614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:39.059318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:39.059627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:39.061195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:39.069319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 502/998] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:39.073736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:39.215532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5523e1c-bf8f-4f8d-b0d8-3b90f60fdd26 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:39.253782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:39.254409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:39.254687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:39.255500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:39.256189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:39.256512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:39.257942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:39.267982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 497/999] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:39.269221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:39.345344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:39.388363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1b6c-76ea-4245-9b83-726b10200682 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:39.425862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392c69-213e-4bac-b43e-dedf017eccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:39.426527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392c69-213e-4bac-b43e-dedf017eccde None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:39.427347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392c69-213e-4bac-b43e-dedf017eccde None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:39.427636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392c69-213e-4bac-b43e-dedf017eccde None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:39.428391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41392c69-213e-4bac-b43e-dedf017eccde None admin] RBAC: Adding query filter params (interface=public, service_id=f620e0f6a64e42da9c191bd2fa90feca, region_id=RegionOne) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:39.428721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41392c69-213e-4bac-b43e-dedf017eccde None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:39.430159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41392c69-213e-4bac-b43e-dedf017eccde None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:39.440843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 503/1000] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Aug 4 21:05:39 2022] GET /identity/v3/endpoints?service_id=f620e0f6a64e42da9c191bd2fa90feca&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:39.442097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:39.487695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:39.576663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b949fb-6b9d-4761-9ad2-b80770dc0f5c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:39.620330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ab659-cf98-4b5b-a0ec-2fdeed2e1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:39.621402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab659-cf98-4b5b-a0ec-2fdeed2e1a70 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:39.621889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab659-cf98-4b5b-a0ec-2fdeed2e1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:39.622378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab659-cf98-4b5b-a0ec-2fdeed2e1a70 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:39.623554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab659-cf98-4b5b-a0ec-2fdeed2e1a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:39.625944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab659-cf98-4b5b-a0ec-2fdeed2e1a70 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:39.636477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 498/1001] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:05:39 2022] GET /identity/v3/services => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:40.507156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443c429-8286-45b7-8529-8a24ea8d0551 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:40.507654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443c429-8286-45b7-8529-8a24ea8d0551 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:40.507731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443c429-8286-45b7-8529-8a24ea8d0551 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:40.509109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 504/1002] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:40.516363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1720fd-3fb4-4f0d-ae6f-44d6ac4c5fd3 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:40.516831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1720fd-3fb4-4f0d-ae6f-44d6ac4c5fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:40.516957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1720fd-3fb4-4f0d-ae6f-44d6ac4c5fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:40.536623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3a1720fd-3fb4-4f0d-ae6f-44d6ac4c5fd3 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:40.538501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3a1720fd-3fb4-4f0d-ae6f-44d6ac4c5fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:40.632955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 499/1003] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:40.660554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443c429-8286-45b7-8529-8a24ea8d0551 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:40.791362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443c429-8286-45b7-8529-8a24ea8d0551 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:40.820330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:40.829468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:40.830118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:40.830402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:40.830676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:40.831424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:40.832724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:40.844383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:40.845481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 21:05:40.846363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:40.852914 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 505/1004] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Aug 4 21:05:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:40.853097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1720fd-3fb4-4f0d-ae6f-44d6ac4c5fd3 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:40.892412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:40.975580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1720fd-3fb4-4f0d-ae6f-44d6ac4c5fd3 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:41.033885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a4eb0-92ed-4999-99f3-7f944a811f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:41.034838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4eb0-92ed-4999-99f3-7f944a811f91 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.035311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4eb0-92ed-4999-99f3-7f944a811f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.035777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4eb0-92ed-4999-99f3-7f944a811f91 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.037239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4eb0-92ed-4999-99f3-7f944a811f91 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:41.037744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4eb0-92ed-4999-99f3-7f944a811f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:41.039339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4eb0-92ed-4999-99f3-7f944a811f91 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:41.045755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 500/1005] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:41.053655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:41.159443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b90be4-43b2-4287-8512-c1c37195ebd5 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.159914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b90be4-43b2-4287-8512-c1c37195ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.160318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b90be4-43b2-4287-8512-c1c37195ebd5 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.162661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 501/1006] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:41.168431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ef32-0575-4a3f-a931-09ebd161dd0e None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.168706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ef32-0575-4a3f-a931-09ebd161dd0e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.169013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ef32-0575-4a3f-a931-09ebd161dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.187006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e0953-89f8-458e-a155-00e603b5ce5e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:41.187785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7699ef32-0575-4a3f-a931-09ebd161dd0e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:41.189009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7699ef32-0575-4a3f-a931-09ebd161dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:41.233975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:41.234605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.234888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.235228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.235866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:41.236206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:41.237579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:41.243480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 506/1007] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Aug 4 21:05:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:41.249564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:41.297705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 502/1008] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:41.325393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:41.332878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ef32-0575-4a3f-a931-09ebd161dd0e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:41.371917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:41.391532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753293b-eaa9-489a-88bc-db1958679483 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:41.453830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c161bf-7f60-4090-8aa1-68ef614950ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:41.454464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c161bf-7f60-4090-8aa1-68ef614950ed None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.454750 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c161bf-7f60-4090-8aa1-68ef614950ed None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.455020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c161bf-7f60-4090-8aa1-68ef614950ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.455743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c161bf-7f60-4090-8aa1-68ef614950ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:41.457172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c161bf-7f60-4090-8aa1-68ef614950ed None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:41.461247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ef32-0575-4a3f-a931-09ebd161dd0e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:41.511718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2d7a6-9f8b-4bae-93c4-041820312d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:41.512352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d7a6-9f8b-4bae-93c4-041820312d1a None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.512630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d7a6-9f8b-4bae-93c4-041820312d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.512920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d7a6-9f8b-4bae-93c4-041820312d1a None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.513663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2d7a6-9f8b-4bae-93c4-041820312d1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:41.515012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2d7a6-9f8b-4bae-93c4-041820312d1a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:41.530470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 507/1009] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:41.624276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 503/1010] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:05:41 2022] POST /identity/v3/services => generated 242 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:41.734432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d48576-fb80-4bb3-8809-01cd100ed4ef None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.734851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d48576-fb80-4bb3-8809-01cd100ed4ef None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.735021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d48576-fb80-4bb3-8809-01cd100ed4ef None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.736455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 508/1011] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:41.743391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fb286-b451-4c52-a1af-cd7a995840cb None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.743687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fb286-b451-4c52-a1af-cd7a995840cb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.743950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fb286-b451-4c52-a1af-cd7a995840cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.765877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2b3fb286-b451-4c52-a1af-cd7a995840cb None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:41.767156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2b3fb286-b451-4c52-a1af-cd7a995840cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:41.878245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 504/1012] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:41 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:41.901844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d48576-fb80-4bb3-8809-01cd100ed4ef None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.031099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d48576-fb80-4bb3-8809-01cd100ed4ef None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.051468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:42.079540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.080199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.080478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.080749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.084129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.084464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:42.095747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:42.096800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 21:05:42.097863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:42.106175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 509/1013] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:42.106385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fb286-b451-4c52-a1af-cd7a995840cb None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.128850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:42.267841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fb286-b451-4c52-a1af-cd7a995840cb None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.312428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.313259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.313632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.313996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.314761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:42.315160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.316657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.323766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 505/1014] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:42.329450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.471467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d3cad-160b-42b7-9ab3-5ef5320aa10d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.523025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f10c12-86dc-4e8a-b6eb-51e064d467d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.523631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10c12-86dc-4e8a-b6eb-51e064d467d3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.523911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10c12-86dc-4e8a-b6eb-51e064d467d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.524210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10c12-86dc-4e8a-b6eb-51e064d467d3 None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.524921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f10c12-86dc-4e8a-b6eb-51e064d467d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:42.525293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f10c12-86dc-4e8a-b6eb-51e064d467d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.526708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f10c12-86dc-4e8a-b6eb-51e064d467d3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.532600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 510/1015] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Aug 4 21:05:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:42.538713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.655303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:42.682960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518da1f-f5f4-4e3e-888f-12905e30cb07 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.719866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d8ab-5a08-4d78-9c05-474fe1a28d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.720486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d8ab-5a08-4d78-9c05-474fe1a28d92 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.720765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d8ab-5a08-4d78-9c05-474fe1a28d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.721070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d8ab-5a08-4d78-9c05-474fe1a28d92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.721955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d8ab-5a08-4d78-9c05-474fe1a28d92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.724219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d8ab-5a08-4d78-9c05-474fe1a28d92 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.816952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 506/1016] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:43.760652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc967b-b2d4-4134-9e9c-f6e617c9671a None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.761275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc967b-b2d4-4134-9e9c-f6e617c9671a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.761275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc967b-b2d4-4134-9e9c-f6e617c9671a None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.762546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 511/1017] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:43.767764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734a70e-cd10-498f-a302-15675f3507cf None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.768176 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734a70e-cd10-498f-a302-15675f3507cf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.768384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734a70e-cd10-498f-a302-15675f3507cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.789090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9734a70e-cd10-498f-a302-15675f3507cf None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:43.790314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9734a70e-cd10-498f-a302-15675f3507cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:43.900930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 507/1018] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:43.924732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc967b-b2d4-4134-9e9c-f6e617c9671a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:43.956204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d7c48-9dbe-4722-b91a-f506da90b6eb None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.956577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d7c48-9dbe-4722-b91a-f506da90b6eb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.956757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d7c48-9dbe-4722-b91a-f506da90b6eb None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.958366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 508/1019] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:43.964247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cf9d8-8dce-4ac5-9830-0c8f94eb24e8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.964596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cf9d8-8dce-4ac5-9830-0c8f94eb24e8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.965187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cf9d8-8dce-4ac5-9830-0c8f94eb24e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.979141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:43.990117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ff7cf9d8-8dce-4ac5-9830-0c8f94eb24e8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:43.991394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ff7cf9d8-8dce-4ac5-9830-0c8f94eb24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:44.069258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc967b-b2d4-4134-9e9c-f6e617c9671a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.080826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:44.095773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 509/1020] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:44.115326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6e6e-a73d-4de8-84d4-0dcb7125d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.117235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6e6e-a73d-4de8-84d4-0dcb7125d0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.117235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6e6e-a73d-4de8-84d4-0dcb7125d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.117235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6e6e-a73d-4de8-84d4-0dcb7125d0d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.119044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6e6e-a73d-4de8-84d4-0dcb7125d0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.119604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cf9d8-8dce-4ac5-9830-0c8f94eb24e8 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.120535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6e6e-a73d-4de8-84d4-0dcb7125d0d5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.122446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 512/1021] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:44.129092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6e6e-a73d-4de8-84d4-0dcb7125d0d5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.251340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cf9d8-8dce-4ac5-9830-0c8f94eb24e8 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.269994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6e6e-a73d-4de8-84d4-0dcb7125d0d5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.287765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:44.304168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.304832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.305158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.305593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] PATH_INFO: `/v3/services/image` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.306716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.309700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.314468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444fe2a-61bb-4282-abbf-f6587c2291a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.315106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444fe2a-61bb-4282-abbf-f6587c2291a3 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.315552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444fe2a-61bb-4282-abbf-f6587c2291a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.316042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444fe2a-61bb-4282-abbf-f6587c2291a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.317368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444fe2a-61bb-4282-abbf-f6587c2291a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.320007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444fe2a-61bb-4282-abbf-f6587c2291a3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:44.320497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:44.321498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:44.336764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 510/1022] 10.222.0.93 () {56 vars in 1105 bytes} [Thu Aug 4 21:05:44 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:44.337965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.391838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:44.441872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438dc4-c67c-4f79-aa5d-ffb6300dfb8b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.471606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 513/1023] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:05:44 2022] POST /identity/v3/projects => generated 311 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:44.484291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.484957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.485236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.485503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.486195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] RBAC: Adding query filter params (name=image) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:44.486496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.488033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.495430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 511/1024] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:44.501380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444fe2a-61bb-4282-abbf-f6587c2291a3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.683154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444fe2a-61bb-4282-abbf-f6587c2291a3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.727359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.727985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.729209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.729209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.729393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] RBAC: Adding query filter params (type=image) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:44.729563 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.730972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.737162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 514/1025] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:44.743580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.875134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e999ee-6288-4837-9aca-8bbb7f033843 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.903455 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:44.923144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22eff99-9b2a-4fd4-bf0f-3cbd58eec352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.924928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eff99-9b2a-4fd4-bf0f-3cbd58eec352 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.924928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eff99-9b2a-4fd4-bf0f-3cbd58eec352 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.924928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eff99-9b2a-4fd4-bf0f-3cbd58eec352 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.925297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22eff99-9b2a-4fd4-bf0f-3cbd58eec352 None admin] RBAC: Adding query filter params (interface=public, service_id=3ebce02a629745ee8607eaaf72e2db01, region_id=RegionOne) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:44.925608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22eff99-9b2a-4fd4-bf0f-3cbd58eec352 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.927086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22eff99-9b2a-4fd4-bf0f-3cbd58eec352 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.936147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 512/1026] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Aug 4 21:05:44 2022] GET /identity/v3/endpoints?service_id=3ebce02a629745ee8607eaaf72e2db01&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:44.938980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.981221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:45.088326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c515d6-0cf9-4947-b149-fb946f4b1b9d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.091858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b98f7e-604a-4be5-b9cc-6b73e5d3f274 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.092140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b98f7e-604a-4be5-b9cc-6b73e5d3f274 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.092399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b98f7e-604a-4be5-b9cc-6b73e5d3f274 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.094044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 513/1027] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:45.102761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f939f-21ea-4c98-83e7-bdfc2b8f308f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.103056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f939f-21ea-4c98-83e7-bdfc2b8f308f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.103512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f939f-21ea-4c98-83e7-bdfc2b8f308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.123230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1d6f939f-21ea-4c98-83e7-bdfc2b8f308f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:45.124506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1d6f939f-21ea-4c98-83e7-bdfc2b8f308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.141004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fddd0-c687-451e-9e61-531523d19afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.142099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fddd0-c687-451e-9e61-531523d19afb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.142525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fddd0-c687-451e-9e61-531523d19afb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.142820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fddd0-c687-451e-9e61-531523d19afb None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.143833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fddd0-c687-451e-9e61-531523d19afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.146314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fddd0-c687-451e-9e61-531523d19afb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.156333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 515/1028] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:05:44 2022] GET /identity/v3/services => generated 1957 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:45.207231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 514/1029] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:45.231648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fddd0-c687-451e-9e61-531523d19afb None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.356978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:45.366890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fddd0-c687-451e-9e61-531523d19afb None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.405938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb1b0f-827d-4a02-b17c-09f3c1a67f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.406588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb1b0f-827d-4a02-b17c-09f3c1a67f62 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.406867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb1b0f-827d-4a02-b17c-09f3c1a67f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.407138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb1b0f-827d-4a02-b17c-09f3c1a67f62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.420239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb1b0f-827d-4a02-b17c-09f3c1a67f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-4beb1b0f-827d-4a02-b17c-09f3c1a67f62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:45.425252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:45.427062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:45.428716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 516/1030] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Aug 4 21:05:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:45.439208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f939f-21ea-4c98-83e7-bdfc2b8f308f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.562204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f939f-21ea-4c98-83e7-bdfc2b8f308f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.577363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:45.603620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.604250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.604521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.604803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.605560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:45.605866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.607242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.619589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 515/1031] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Aug 4 21:05:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:45.625123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb1b0f-827d-4a02-b17c-09f3c1a67f62 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.748834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb1b0f-827d-4a02-b17c-09f3c1a67f62 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.790731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.791702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.792017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.792293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.805846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.807362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:45.833112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:45.834890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:45.836132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:45.836132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:45.836132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:45.836132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:45.836132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 517/1032] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:45.841376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.985134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948515e9-adba-4124-8745-abcd5d290153 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.031624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.032268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.032551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.032822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.033669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:46.034205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.037786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.056641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 516/1033] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:46.065631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.069877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:46.192848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add74c0-f57b-4d91-8910-24753c094fc7 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.238161 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.238817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.239660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.239940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.249009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.250563 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:46.272371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:46.273437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:46.274402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:46.277209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 518/1034] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:46.279398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.318471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:46.404992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805e88d-e76b-45b6-a128-1d37542e558e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.450757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a53b9-2377-4024-a7c5-833759502b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.451385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a53b9-2377-4024-a7c5-833759502b1a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.451658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a53b9-2377-4024-a7c5-833759502b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.451927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a53b9-2377-4024-a7c5-833759502b1a None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.452725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a53b9-2377-4024-a7c5-833759502b1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:46.453061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a53b9-2377-4024-a7c5-833759502b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.454570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a53b9-2377-4024-a7c5-833759502b1a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.476786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 517/1035] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:46.483127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.575939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:46.619173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458bc8-b57e-4f05-80a4-3f331738189b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.655850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2a6c-f9a8-4b4d-bee2-4ca3b5a4984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.656474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2a6c-f9a8-4b4d-bee2-4ca3b5a4984d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.656751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2a6c-f9a8-4b4d-bee2-4ca3b5a4984d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.657057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2a6c-f9a8-4b4d-bee2-4ca3b5a4984d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.727401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa8df-5b3a-44fc-a479-76df591ea012 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.727958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa8df-5b3a-44fc-a479-76df591ea012 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.728236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa8df-5b3a-44fc-a479-76df591ea012 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.730320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 518/1036] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:46.736267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245e84c-e9c2-4eaa-a907-8ddc7c0c7578 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.737106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245e84c-e9c2-4eaa-a907-8ddc7c0c7578 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.737502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245e84c-e9c2-4eaa-a907-8ddc7c0c7578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.749955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca2a6c-f9a8-4b4d-bee2-4ca3b5a4984d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.751465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca2a6c-f9a8-4b4d-bee2-4ca3b5a4984d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.756819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c245e84c-e9c2-4eaa-a907-8ddc7c0c7578 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:46.758043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c245e84c-e9c2-4eaa-a907-8ddc7c0c7578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:46.827978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:46.836569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 519/1037] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:46.867185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245e84c-e9c2-4eaa-a907-8ddc7c0c7578 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.892938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 519/1038] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 21:05:46.894154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2a6c-f9a8-4b4d-bee2-4ca3b5a4984d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.900619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:47.021499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245e84c-e9c2-4eaa-a907-8ddc7c0c7578 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.068845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2a6c-f9a8-4b4d-bee2-4ca3b5a4984d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.082097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230991-5019-4eed-a19c-80970aaecd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.083979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230991-5019-4eed-a19c-80970aaecd29 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.084737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230991-5019-4eed-a19c-80970aaecd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.085257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230991-5019-4eed-a19c-80970aaecd29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.087031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c230991-5019-4eed-a19c-80970aaecd29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.088476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c230991-5019-4eed-a19c-80970aaecd29 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.090474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 520/1039] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:47.096143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230991-5019-4eed-a19c-80970aaecd29 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.130299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.131314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.132770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.132770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.148071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.149593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:47.172016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:47.173118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:47.174004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:47.174004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:47.174004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:47.174004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:47.174004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 520/1040] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:47.179815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.200959 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:47.248151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:47.265910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230991-5019-4eed-a19c-80970aaecd29 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.322479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ab9f-15c2-4d85-bf64-6dd42e3382eb None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.324941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c412980-4fe3-42e9-aade-30765633be88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.325568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412980-4fe3-42e9-aade-30765633be88 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.325853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412980-4fe3-42e9-aade-30765633be88 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.326126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412980-4fe3-42e9-aade-30765633be88 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.327066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c412980-4fe3-42e9-aade-30765633be88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.328552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c412980-4fe3-42e9-aade-30765633be88 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.360859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.361457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.362314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.362314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.362873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:47.363174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.364596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.378949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 521/1041] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:47.386740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.411279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 521/1042] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:05:47 2022] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:47.460200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896be2-fc92-47f2-8b34-7f6043c67c70 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.460526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896be2-fc92-47f2-8b34-7f6043c67c70 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.460781 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896be2-fc92-47f2-8b34-7f6043c67c70 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.464920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 522/1043] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:47.468795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8eee6-fa2b-4319-952b-bd0eb49e98f2 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.469342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8eee6-fa2b-4319-952b-bd0eb49e98f2 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.470136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8eee6-fa2b-4319-952b-bd0eb49e98f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.505351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-5bb8eee6-fa2b-4319-952b-bd0eb49e98f2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:47.506991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5bb8eee6-fa2b-4319-952b-bd0eb49e98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:47.512337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:47.574321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a77203-f15b-40ec-84e4-9df3118c45bc None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.615566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 523/1044] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:47.628484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.629194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.630127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.630407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.639129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.640616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.652162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8eee6-fa2b-4319-952b-bd0eb49e98f2 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:47.664283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:47.665653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:47.667463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 522/1045] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:47.676500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.767809 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:47.794494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8eee6-fa2b-4319-952b-bd0eb49e98f2 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.830826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01362d4a-3884-4b6e-93d9-1c89fbe9e82f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.837532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.838256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.838785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.839062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.840560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.841967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:47.853315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:47.854397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:47.855244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 524/1046] 10.222.0.93 () {56 vars in 1105 bytes} [Thu Aug 4 21:05:47 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:47.860649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.878583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.879103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.879671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.879847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.880529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:47.881400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.882433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.884702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:47.898521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 523/1047] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:47.905517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.982340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964e0d4-6c48-407c-a3dc-ad11c0b3c6b0 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:48.028435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:48.029244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:48.029675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:48.030160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:48.030877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] RBAC: Adding query filter params (name=image) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:48.031178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:48.032623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:48.044784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 525/1048] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:48.045508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5382174-2404-485e-bafe-4a310e471960 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:48.047031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:48.059322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:48.092090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:48.092789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:48.093040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:48.093328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:48.094223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] RBAC: Adding query filter params (role.id=4522d797836940d19cb619ddd44d3d6e, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=66a82e8f2e304418adce1935fe7abcb8) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:48.094538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:48.096037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:48.103332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 524/1049] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:47 2022] GET /identity/v3/role_assignments?user.id=66a82e8f2e304418adce1935fe7abcb8&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=4522d797836940d19cb619ddd44d3d6e => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:48.235558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7ee90-d626-4f18-a27e-1a5025f97702 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:48.288203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32357099-6af0-4fbb-8122-1bdd8ac78eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:48.288837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32357099-6af0-4fbb-8122-1bdd8ac78eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:48.289139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32357099-6af0-4fbb-8122-1bdd8ac78eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:48.289459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32357099-6af0-4fbb-8122-1bdd8ac78eb3 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:48.290100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32357099-6af0-4fbb-8122-1bdd8ac78eb3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:48.290408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32357099-6af0-4fbb-8122-1bdd8ac78eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:48.292049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32357099-6af0-4fbb-8122-1bdd8ac78eb3 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:48.302884 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 526/1050] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:48.304074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:48.374536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:48.419333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245b78-7c67-45cb-a8d4-533bf2fcfa9a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:48.466583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d9281-14c3-4b2f-91fe-6e2e46f9d96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:48.467966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9281-14c3-4b2f-91fe-6e2e46f9d96a None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:48.468254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9281-14c3-4b2f-91fe-6e2e46f9d96a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:48.468533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d9281-14c3-4b2f-91fe-6e2e46f9d96a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:48.469284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d9281-14c3-4b2f-91fe-6e2e46f9d96a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:48.470670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d9281-14c3-4b2f-91fe-6e2e46f9d96a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:48.590454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 525/1051] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:49.686392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc4f6-a25e-44c0-aae9-fbe1a1027170 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.687141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc4f6-a25e-44c0-aae9-fbe1a1027170 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.687141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bc4f6-a25e-44c0-aae9-fbe1a1027170 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.688468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 527/1052] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:49.694413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665620-d548-4bde-89b9-ef8bfc756c5b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.694899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665620-d548-4bde-89b9-ef8bfc756c5b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.694985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665620-d548-4bde-89b9-ef8bfc756c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.714785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-48665620-d548-4bde-89b9-ef8bfc756c5b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:49.715999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-48665620-d548-4bde-89b9-ef8bfc756c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:49.817007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 526/1053] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:49.843884 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bc4f6-a25e-44c0-aae9-fbe1a1027170 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:49.932658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:49.971764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bc4f6-a25e-44c0-aae9-fbe1a1027170 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.034829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24bf49-ba7f-4a94-b3c8-b33f37a01ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.036720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24bf49-ba7f-4a94-b3c8-b33f37a01ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.037245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24bf49-ba7f-4a94-b3c8-b33f37a01ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.037724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24bf49-ba7f-4a94-b3c8-b33f37a01ea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.057606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24bf49-ba7f-4a94-b3c8-b33f37a01ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-7c24bf49-ba7f-4a94-b3c8-b33f37a01ea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:50.068205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:50.069529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:50.070463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:50.073225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 528/1054] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:50.079873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665620-d548-4bde-89b9-ef8bfc756c5b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.155897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:50.178400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ca76-229c-4e06-9ca6-8aff1ffa3589 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.178675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ca76-229c-4e06-9ca6-8aff1ffa3589 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.179005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ca76-229c-4e06-9ca6-8aff1ffa3589 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.180393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 529/1055] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:05:50.185378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989a7a-b363-4206-8753-90b5ccc276e1 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.185841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989a7a-b363-4206-8753-90b5ccc276e1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.186009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989a7a-b363-4206-8753-90b5ccc276e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.204636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-82989a7a-b363-4206-8753-90b5ccc276e1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:50.210938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-82989a7a-b363-4206-8753-90b5ccc276e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:50.244595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665620-d548-4bde-89b9-ef8bfc756c5b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.301545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 530/1056] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:05:50.307305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.307509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.308204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.308788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.310356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:50.310664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.312064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.329210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 527/1057] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:50.329474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82989a7a-b363-4206-8753-90b5ccc276e1 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.337207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.412498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:50.466891 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60875-30db-46c4-9505-67c61a278426 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.469600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:50.486783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82989a7a-b363-4206-8753-90b5ccc276e1 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.528665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78672c-52db-40f9-a136-9f8e6e9f0d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.529671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78672c-52db-40f9-a136-9f8e6e9f0d29 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.530267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78672c-52db-40f9-a136-9f8e6e9f0d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.531013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78672c-52db-40f9-a136-9f8e6e9f0d29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.543062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78672c-52db-40f9-a136-9f8e6e9f0d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:50.543283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a93b36-1244-45be-a12b-a4dccf6f0dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.544322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a93b36-1244-45be-a12b-a4dccf6f0dff None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.545061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a93b36-1244-45be-a12b-a4dccf6f0dff None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.545593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a93b36-1244-45be-a12b-a4dccf6f0dff None admin] PATH_INFO: `/v3/users/0580878abb39411e841bd9ec68a8efd1` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-0e78672c-52db-40f9-a136-9f8e6e9f0d29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:50.548489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:50.549570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:50.554076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 528/1058] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:50.556698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78672c-52db-40f9-a136-9f8e6e9f0d29 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.581594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a93b36-1244-45be-a12b-a4dccf6f0dff None admin] RBAC: Authorizing `identity:get_user(user_id=0580878abb39411e841bd9ec68a8efd1)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.585669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a93b36-1244-45be-a12b-a4dccf6f0dff None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.593540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 531/1059] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/users/0580878abb39411e841bd9ec68a8efd1 => generated 285 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:50.595044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a93b36-1244-45be-a12b-a4dccf6f0dff None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.717637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78672c-52db-40f9-a136-9f8e6e9f0d29 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.748807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a93b36-1244-45be-a12b-a4dccf6f0dff None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.763345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.763967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.764243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.764515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.765265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:50.765570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.766972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.775218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:50.781324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 529/1060] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:50.783062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.813015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17a253-46c0-43b7-b1cb-b11f7102901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.814055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a253-46c0-43b7-b1cb-b11f7102901e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.814521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a253-46c0-43b7-b1cb-b11f7102901e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.814990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a253-46c0-43b7-b1cb-b11f7102901e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.833715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:50.914667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17a253-46c0-43b7-b1cb-b11f7102901e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.917704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17a253-46c0-43b7-b1cb-b11f7102901e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.939644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538925-e96f-4f73-a580-ca8378909aa2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.981190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0b0ad-b192-4376-8411-b760edf10c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.981971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0b0ad-b192-4376-8411-b760edf10c9c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.982326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0b0ad-b192-4376-8411-b760edf10c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.982745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0b0ad-b192-4376-8411-b760edf10c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.999021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0b0ad-b192-4376-8411-b760edf10c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.001124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0b0ad-b192-4376-8411-b760edf10c9c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-4fa0b0ad-b192-4376-8411-b760edf10c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:51.017601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:51.018622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:51.019516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:51.019516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:51.019516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:51.019516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:51.019516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 530/1061] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:51.020565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2e97-712a-4f9b-ae92-bfc3569fd051 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.020850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2e97-712a-4f9b-ae92-bfc3569fd051 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.021149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2e97-712a-4f9b-ae92-bfc3569fd051 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.022759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 531/1062] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:51.026040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc2e97-712a-4f9b-ae92-bfc3569fd051 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.062471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 532/1063] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 21:05:51.063957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0ad9-c71e-459e-8fb6-e6a58a63ff7f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.064241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0ad9-c71e-459e-8fb6-e6a58a63ff7f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.064515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0ad9-c71e-459e-8fb6-e6a58a63ff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.091907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-79ee0ad9-c71e-459e-8fb6-e6a58a63ff7f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:51.093723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-79ee0ad9-c71e-459e-8fb6-e6a58a63ff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:51.110521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:51.145898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:51.172615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc2e97-712a-4f9b-ae92-bfc3569fd051 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.178164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 533/1064] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:51.179004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0ad9-c71e-459e-8fb6-e6a58a63ff7f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.219065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.219685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.219964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.220243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.220979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:51.221288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.223241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.238434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 532/1065] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:51.240954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.314711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0ad9-c71e-459e-8fb6-e6a58a63ff7f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.366469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5388-2b46-4a49-8f58-8fc910c442dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.367375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5388-2b46-4a49-8f58-8fc910c442dd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.367801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5388-2b46-4a49-8f58-8fc910c442dd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.368243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5388-2b46-4a49-8f58-8fc910c442dd None admin] PATH_INFO: `/v3/projects/85b46495a74142c7b159bc571b18c188` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.370091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de5388-2b46-4a49-8f58-8fc910c442dd None admin] RBAC: Authorizing `identity:get_project(project_id=85b46495a74142c7b159bc571b18c188)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.372578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de5388-2b46-4a49-8f58-8fc910c442dd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.375335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 534/1066] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/projects/85b46495a74142c7b159bc571b18c188 => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:51.376425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5388-2b46-4a49-8f58-8fc910c442dd None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.398123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:51.399483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd609a0-5566-4d87-8308-4480b8e6d059 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.435414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8197d-29a7-4771-b2ad-e5430f22505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.436032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8197d-29a7-4771-b2ad-e5430f22505e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.436313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8197d-29a7-4771-b2ad-e5430f22505e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.436611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8197d-29a7-4771-b2ad-e5430f22505e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.440575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:51.513623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5388-2b46-4a49-8f58-8fc910c442dd None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.524273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8197d-29a7-4771-b2ad-e5430f22505e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.525766 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8197d-29a7-4771-b2ad-e5430f22505e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.563864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.563864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.563864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.564423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.572716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.574204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:51.587285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:51.588606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 535/1067] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:51.589879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.673371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 533/1068] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:05:51.673371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8197d-29a7-4771-b2ad-e5430f22505e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.685829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:51.714174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eb45f-3c4d-44f3-a1bb-c7d93c7f3804 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.718325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:51.760244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.761215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.761321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.761552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.762405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=85b46495a74142c7b159bc571b18c188, user.id=0580878abb39411e841bd9ec68a8efd1) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:51.762715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.764139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.769865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 536/1069] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/role_assignments?user.id=0580878abb39411e841bd9ec68a8efd1&scope.project.id=85b46495a74142c7b159bc571b18c188&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:51.771572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.812615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8197d-29a7-4771-b2ad-e5430f22505e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.870288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.871364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.871818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.872250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.873648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:51.874274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.876809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.909115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 534/1070] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:51.919546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.948870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a9d7-65d4-48e3-98a3-53959de1c03a None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.997060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.997801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.998147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.998524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.011430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:52.018196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.019748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:52.039749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:52.040736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:52.042091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:52.042091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:52.042091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:52.042091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:52.042091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 537/1071] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:52.047531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.062454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:52.073396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42a9e-201f-4ee7-b894-ddfc4404b43b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.115901 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.116615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.117140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.117265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.131328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.133990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:52.154240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:52.155224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:52.161601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:52.161601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:52.161601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:52.161601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:52.161601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 535/1072] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:52.164351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.202519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fc9e5-3160-4e8a-b8eb-30049ffe7402 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.261421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.261660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.262121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.262596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.263698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:52.264200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.266731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.293944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 538/1073] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:52.335077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d447f-f448-4c55-bd7e-9984804ab9a5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.395705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.396386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.397198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.397700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.398960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:52.399477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.401996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.430970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 536/1074] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:52.432870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.527586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:52.616852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80714d5-ce8b-44f2-a806-96940dec25a7 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.676082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.677717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.678198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.678666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.690419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.693648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:52.711992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:52.714111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:52.716243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 539/1075] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:52.722766 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.733681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:52.842736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794f16a-c5cb-4866-b803-5ff6ca201758 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.889121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb437fd-0717-4449-813f-05a8cd7b2534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.889759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb437fd-0717-4449-813f-05a8cd7b2534 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.890045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb437fd-0717-4449-813f-05a8cd7b2534 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.890325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb437fd-0717-4449-813f-05a8cd7b2534 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.891175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb437fd-0717-4449-813f-05a8cd7b2534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:52.891486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb437fd-0717-4449-813f-05a8cd7b2534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.893087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb437fd-0717-4449-813f-05a8cd7b2534 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.907631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 537/1076] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:52.916522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.077041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f60ed-0842-4596-9c62-81542c4f371d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.092625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:53.123397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3ee16-a653-4c0b-a3e5-8393297c5605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.123959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3ee16-a653-4c0b-a3e5-8393297c5605 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.124237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3ee16-a653-4c0b-a3e5-8393297c5605 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.124510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3ee16-a653-4c0b-a3e5-8393297c5605 None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/66a82e8f2e304418adce1935fe7abcb8/roles/4522d797836940d19cb619ddd44d3d6e` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.126776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3ee16-a653-4c0b-a3e5-8393297c5605 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=66a82e8f2e304418adce1935fe7abcb8, role_id=4522d797836940d19cb619ddd44d3d6e)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.128265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3ee16-a653-4c0b-a3e5-8393297c5605 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.205422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 540/1077] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:05:52 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/66a82e8f2e304418adce1935fe7abcb8/roles/4522d797836940d19cb619ddd44d3d6e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:53.993512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f8344-87bf-4413-96fe-fceac81905cf None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.994077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f8344-87bf-4413-96fe-fceac81905cf None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.994481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f8344-87bf-4413-96fe-fceac81905cf None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.996375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 538/1078] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:54.002075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192a76-e247-4e4c-888f-092c6f661068 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.002589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192a76-e247-4e4c-888f-092c6f661068 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.002733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192a76-e247-4e4c-888f-092c6f661068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.021245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-81192a76-e247-4e4c-888f-092c6f661068 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:54.022512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-81192a76-e247-4e4c-888f-092c6f661068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:54.102886 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 541/1079] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:54.126808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f8344-87bf-4413-96fe-fceac81905cf None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.236467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:54.288307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f8344-87bf-4413-96fe-fceac81905cf None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.339915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b69c7-f3b7-4010-9153-01a880ec1445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.341049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b69c7-f3b7-4010-9153-01a880ec1445 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.347941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b69c7-f3b7-4010-9153-01a880ec1445 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.347941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b69c7-f3b7-4010-9153-01a880ec1445 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.362270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b69c7-f3b7-4010-9153-01a880ec1445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-197b69c7-f3b7-4010-9153-01a880ec1445 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:54.373816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:54.374883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:54.375735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:54.376377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 539/1080] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:54.384183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81192a76-e247-4e4c-888f-092c6f661068 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.535573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:54.539228 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81192a76-e247-4e4c-888f-092c6f661068 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.574502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.575108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.575378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.575643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.576343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:54.576641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.578027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.588516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 542/1081] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:54.596654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b69c7-f3b7-4010-9153-01a880ec1445 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.732341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b69c7-f3b7-4010-9153-01a880ec1445 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.769398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:54.778983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bcf57-e6da-467a-9a9a-2ebf122622d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.782356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcf57-e6da-467a-9a9a-2ebf122622d7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.782356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcf57-e6da-467a-9a9a-2ebf122622d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.782356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcf57-e6da-467a-9a9a-2ebf122622d7 None admin] PATH_INFO: `/v3/users/0580878abb39411e841bd9ec68a8efd1` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.782356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bcf57-e6da-467a-9a9a-2ebf122622d7 None admin] RBAC: Authorizing `identity:get_user(user_id=0580878abb39411e841bd9ec68a8efd1)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.782845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bcf57-e6da-467a-9a9a-2ebf122622d7 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.784442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 540/1082] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:05:54 2022] GET /identity/v3/users/0580878abb39411e841bd9ec68a8efd1 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:54.793933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.901599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9985-4e43-4edb-9751-7a39343a682b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.945539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c46005-2e87-4020-bdf3-09ba10044801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.946180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46005-2e87-4020-bdf3-09ba10044801 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.946454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46005-2e87-4020-bdf3-09ba10044801 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.946720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46005-2e87-4020-bdf3-09ba10044801 None admin] PATH_INFO: `/v3/projects/85b46495a74142c7b159bc571b18c188` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.948469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c46005-2e87-4020-bdf3-09ba10044801 None admin] RBAC: Authorizing `identity:get_project(project_id=85b46495a74142c7b159bc571b18c188)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.951017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c46005-2e87-4020-bdf3-09ba10044801 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.959593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 543/1083] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:05:54 2022] GET /identity/v3/projects/85b46495a74142c7b159bc571b18c188 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:54.964387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bcf57-e6da-467a-9a9a-2ebf122622d7 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:55.082273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bcf57-e6da-467a-9a9a-2ebf122622d7 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:55.121720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fee04d-e6ae-4df9-955a-bc4e2d4a1305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:55.122386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee04d-e6ae-4df9-955a-bc4e2d4a1305 None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:55.122658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee04d-e6ae-4df9-955a-bc4e2d4a1305 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:55.122982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee04d-e6ae-4df9-955a-bc4e2d4a1305 None admin] PATH_INFO: `/v3/projects/85b46495a74142c7b159bc571b18c188/users/0580878abb39411e841bd9ec68a8efd1/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:55.124943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fee04d-e6ae-4df9-955a-bc4e2d4a1305 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b46495a74142c7b159bc571b18c188, user_id=0580878abb39411e841bd9ec68a8efd1, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:55.126366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fee04d-e6ae-4df9-955a-bc4e2d4a1305 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:55.204523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 541/1084] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:05:54 2022] PUT /identity/v3/projects/85b46495a74142c7b159bc571b18c188/users/0580878abb39411e841bd9ec68a8efd1/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:55.287043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cb15e-7330-4cc0-a803-1b0523025080 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:55.287598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cb15e-7330-4cc0-a803-1b0523025080 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:55.287598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cb15e-7330-4cc0-a803-1b0523025080 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:55.289346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 544/1085] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:55.295297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdaaa4-87be-4cd3-ace0-3d223a01c14c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:55.295606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdaaa4-87be-4cd3-ace0-3d223a01c14c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:55.295880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdaaa4-87be-4cd3-ace0-3d223a01c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:55.315582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-efcdaaa4-87be-4cd3-ace0-3d223a01c14c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:55.317624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-efcdaaa4-87be-4cd3-ace0-3d223a01c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:55.375066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:55.393917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 542/1086] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:55.418233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cb15e-7330-4cc0-a803-1b0523025080 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:55.452489 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:55.542368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cb15e-7330-4cc0-a803-1b0523025080 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:55.577093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e515f-fae1-473a-b8e7-13c3cc9663f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:55.577718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e515f-fae1-473a-b8e7-13c3cc9663f5 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:55.577988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e515f-fae1-473a-b8e7-13c3cc9663f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:55.578253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e515f-fae1-473a-b8e7-13c3cc9663f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:55.588750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e515f-fae1-473a-b8e7-13c3cc9663f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-f96e515f-fae1-473a-b8e7-13c3cc9663f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:55.593780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:55.594843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:55.595800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 545/1087] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Aug 4 21:05:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:55.602026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdaaa4-87be-4cd3-ace0-3d223a01c14c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:55.706480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdaaa4-87be-4cd3-ace0-3d223a01c14c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:55.743687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:55.744303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:55.744576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:55.744840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:55.745578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:55.745876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:55.748410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:55.757308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 543/1088] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Aug 4 21:05:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:55.763179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e515f-fae1-473a-b8e7-13c3cc9663f5 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:55.856230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:55.865906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e515f-fae1-473a-b8e7-13c3cc9663f5 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:55.899925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:55.900765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:55.901131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:55.901547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:55.913083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:55.914595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:55.930661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:55.931639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:55.932570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:55.932570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:55.932570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:55.932570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:55.932570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 546/1089] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:55.937991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:55.986229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:56.047909 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e49b5-f2f3-46f0-9f0f-bee58744d56d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:56.084697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:56.085799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:56.085799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:56.086123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:56.086831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:56.087134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:56.088528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:56.102935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 544/1090] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:56.108908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:56.220795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be952879-58c2-4b9d-85ec-67b7cf3c3b65 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:56.258359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:56.258904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:56.259451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:56.259451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:56.267720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:56.269386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:05:56.281904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:56.283731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:56.286723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 547/1091] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Aug 4 21:05:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:56.291705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:56.406856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f719fe1-1575-4814-bed4-f72c46877c2a None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:56.416043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:56.444395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:56.445061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:56.445324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:56.445579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:56.446366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:56.446666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:56.448096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:56.468263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 545/1092] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Aug 4 21:05:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:56.475382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:56.479047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:56.608233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc7026-5e8a-4486-9d16-2d81193bed62 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:56.648551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1414f2-ae0a-45af-b15a-ec4d052a5e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:56.649198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1414f2-ae0a-45af-b15a-ec4d052a5e28 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:56.649472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1414f2-ae0a-45af-b15a-ec4d052a5e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:56.649739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1414f2-ae0a-45af-b15a-ec4d052a5e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:56.721411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1414f2-ae0a-45af-b15a-ec4d052a5e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:56.722872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1414f2-ae0a-45af-b15a-ec4d052a5e28 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:56.725704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:56.827702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 548/1093] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 21:05:56.834041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:56.956108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7972fb-ac84-46da-8bdb-91318ebc2ff4 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:56.999337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:56.999984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.000261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.000533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.012531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:57.014049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:05:57.035011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:57.037322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:57.038740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:05:57.038740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:05:57.038740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:05:57.038740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:57.041052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 546/1094] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:57.043456 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1414f2-ae0a-45af-b15a-ec4d052a5e28 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:57.181837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1414f2-ae0a-45af-b15a-ec4d052a5e28 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:57.184189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:57.230586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe21f05-45d3-41ee-bf11-3d079fd57309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:57.231652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe21f05-45d3-41ee-bf11-3d079fd57309 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.232166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe21f05-45d3-41ee-bf11-3d079fd57309 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.232662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe21f05-45d3-41ee-bf11-3d079fd57309 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.234107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe21f05-45d3-41ee-bf11-3d079fd57309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:57.234644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe21f05-45d3-41ee-bf11-3d079fd57309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:57.237457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe21f05-45d3-41ee-bf11-3d079fd57309 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:57.263505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 549/1095] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:57.273438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:57.315376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:57.318276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7010-0324-460b-9466-2420dfdc70d9 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.319054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7010-0324-460b-9466-2420dfdc70d9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.319290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7010-0324-460b-9466-2420dfdc70d9 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.321995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 550/1096] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:05:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:05:57.331788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a368-e4d5-4697-a679-79ddecf2d5da None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.332294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a368-e4d5-4697-a679-79ddecf2d5da None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.332804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a368-e4d5-4697-a679-79ddecf2d5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.362370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1350a368-e4d5-4697-a679-79ddecf2d5da None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:57.364485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1350a368-e4d5-4697-a679-79ddecf2d5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:57.447552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66ebe-fe68-4e66-bded-cb83f2286bb9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:57.453111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 551/1097] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:05:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:05:57.473645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350a368-e4d5-4697-a679-79ddecf2d5da None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:57.492720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:57.493297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.493577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.493870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.505612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:57.508223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:05:57.522419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:57.523453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:05:57.524366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 547/1098] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:05:57.529944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:57.592707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:57.602658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350a368-e4d5-4697-a679-79ddecf2d5da None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:57.633722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:57.641422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679df87a-a667-4876-a869-7ec29256a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:57.642073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679df87a-a667-4876-a869-7ec29256a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.642347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679df87a-a667-4876-a869-7ec29256a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.642615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679df87a-a667-4876-a869-7ec29256a7c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.655010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679df87a-a667-4876-a869-7ec29256a7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-679df87a-a667-4876-a869-7ec29256a7c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:05:57.661025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:05:57.662246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:05:57.663108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 552/1099] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:05:57.668680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679df87a-a667-4876-a869-7ec29256a7c8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:57.676799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f590e36-d3e9-4e87-b6ba-5c4074422942 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:57.725896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:57.727060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.727532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.727972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.729244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:57.729576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:57.731677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:57.750733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 548/1100] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:57.758440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:57.783031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679df87a-a667-4876-a869-7ec29256a7c8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:57.833735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:57.834371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.834688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.834956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.835672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:57.835974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:57.837358 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:57.846075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 553/1101] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:57.853698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:57.874394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:57.909435 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25a423-568a-4d05-9dc6-42937b384097 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:57.966742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:57.967368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.967646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.967918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.968707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] RBAC: Adding query filter params (role.id=4522d797836940d19cb619ddd44d3d6e, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=66a82e8f2e304418adce1935fe7abcb8) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:57.969045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:57.970485 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:57.974199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:57.989046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 549/1102] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:57 2022] GET /identity/v3/role_assignments?user.id=66a82e8f2e304418adce1935fe7abcb8&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=4522d797836940d19cb619ddd44d3d6e => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:57.996865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43adf5-49ab-43f6-adc9-e865cc3488e4 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.037142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89c27b-7f32-443a-ab4b-4e807875b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.037921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89c27b-7f32-443a-ab4b-4e807875b370 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.038283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89c27b-7f32-443a-ab4b-4e807875b370 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.038654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89c27b-7f32-443a-ab4b-4e807875b370 None admin] PATH_INFO: `/v3/users/0580878abb39411e841bd9ec68a8efd1` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.040007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89c27b-7f32-443a-ab4b-4e807875b370 None admin] RBAC: Authorizing `identity:get_user(user_id=0580878abb39411e841bd9ec68a8efd1)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.041865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89c27b-7f32-443a-ab4b-4e807875b370 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.043849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 554/1103] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:05:57 2022] GET /identity/v3/users/0580878abb39411e841bd9ec68a8efd1 => generated 285 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:58.050422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.161700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972306a-7eb4-4260-95dc-aac62feec89d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.199186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a5cf5-97ec-4c96-96d0-79d42e05862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.199809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a5cf5-97ec-4c96-96d0-79d42e05862d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.200083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a5cf5-97ec-4c96-96d0-79d42e05862d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.200350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a5cf5-97ec-4c96-96d0-79d42e05862d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.273171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:58.275359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a5cf5-97ec-4c96-96d0-79d42e05862d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.276901 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a5cf5-97ec-4c96-96d0-79d42e05862d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.383837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 550/1104] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 21:05:58.389900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89c27b-7f32-443a-ab4b-4e807875b370 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.477530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:58.497222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89c27b-7f32-443a-ab4b-4e807875b370 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.543458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c330c-255f-4868-9d36-9c07d788fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.544197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c330c-255f-4868-9d36-9c07d788fc86 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.544379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c330c-255f-4868-9d36-9c07d788fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.544689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c330c-255f-4868-9d36-9c07d788fc86 None admin] PATH_INFO: `/v3/projects/85b46495a74142c7b159bc571b18c188` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.545910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c330c-255f-4868-9d36-9c07d788fc86 None admin] RBAC: Authorizing `identity:get_project(project_id=85b46495a74142c7b159bc571b18c188)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.547352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c330c-255f-4868-9d36-9c07d788fc86 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.549296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 555/1105] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/projects/85b46495a74142c7b159bc571b18c188 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:58.556204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a5cf5-97ec-4c96-96d0-79d42e05862d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.672046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:58.675171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a5cf5-97ec-4c96-96d0-79d42e05862d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.713214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58184c8a-f9a0-47c5-8106-cdafd7a4f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.713835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184c8a-f9a0-47c5-8106-cdafd7a4f190 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.714114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184c8a-f9a0-47c5-8106-cdafd7a4f190 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.714385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184c8a-f9a0-47c5-8106-cdafd7a4f190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.715213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58184c8a-f9a0-47c5-8106-cdafd7a4f190 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=85b46495a74142c7b159bc571b18c188, user.id=0580878abb39411e841bd9ec68a8efd1) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:58.715526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58184c8a-f9a0-47c5-8106-cdafd7a4f190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.717107 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58184c8a-f9a0-47c5-8106-cdafd7a4f190 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.724707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 551/1106] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/role_assignments?user.id=0580878abb39411e841bd9ec68a8efd1&scope.project.id=85b46495a74142c7b159bc571b18c188&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:06:00.803805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536894-eb49-4b6e-b352-cff671ef6df9 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:00.804373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536894-eb49-4b6e-b352-cff671ef6df9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:00.804373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536894-eb49-4b6e-b352-cff671ef6df9 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:00.805817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 556/1107] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:06:00.811031 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad81dc-c1fc-402e-956f-f4eb1fe81cbc None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:00.811457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad81dc-c1fc-402e-956f-f4eb1fe81cbc None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:00.811565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad81dc-c1fc-402e-956f-f4eb1fe81cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:00.829606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f2ad81dc-c1fc-402e-956f-f4eb1fe81cbc None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:00.830805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f2ad81dc-c1fc-402e-956f-f4eb1fe81cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:00.899337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 552/1108] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:00.924431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb536894-eb49-4b6e-b352-cff671ef6df9 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:01.027755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb536894-eb49-4b6e-b352-cff671ef6df9 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:01.062431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30379c4e-1995-49e2-b0a4-79e96b94b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:01.062998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379c4e-1995-49e2-b0a4-79e96b94b80c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:01.063278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379c4e-1995-49e2-b0a4-79e96b94b80c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:01.063528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379c4e-1995-49e2-b0a4-79e96b94b80c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:01.064656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30379c4e-1995-49e2-b0a4-79e96b94b80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:01.066241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30379c4e-1995-49e2-b0a4-79e96b94b80c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:01.068237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 557/1109] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:06:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:01.074088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad81dc-c1fc-402e-956f-f4eb1fe81cbc None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:01.168998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:01.175189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad81dc-c1fc-402e-956f-f4eb1fe81cbc None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:01.209610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22983a33-1796-4646-b4ca-352f6d292bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:01.210221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983a33-1796-4646-b4ca-352f6d292bc3 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:01.210500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983a33-1796-4646-b4ca-352f6d292bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:01.210770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983a33-1796-4646-b4ca-352f6d292bc3 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:01.211451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22983a33-1796-4646-b4ca-352f6d292bc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:01.212911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22983a33-1796-4646-b4ca-352f6d292bc3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:01.307053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 553/1110] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:06:01 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:06:03.428326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bda12-47db-4c4b-a858-5ad999c9747c None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:03.429223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bda12-47db-4c4b-a858-5ad999c9747c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:03.429223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bda12-47db-4c4b-a858-5ad999c9747c None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:03.430362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 558/1111] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:03.436650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a5da8-73f1-4d81-8c72-297dd54ad845 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:03.437109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a5da8-73f1-4d81-8c72-297dd54ad845 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:03.437221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a5da8-73f1-4d81-8c72-297dd54ad845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:03.456733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-834a5da8-73f1-4d81-8c72-297dd54ad845 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:03.458192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-834a5da8-73f1-4d81-8c72-297dd54ad845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:03.538148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 554/1112] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:03.563595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bda12-47db-4c4b-a858-5ad999c9747c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:03.583178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:03.667881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bda12-47db-4c4b-a858-5ad999c9747c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:03.702827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b1ce1-f090-4780-ad45-683126ead0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:03.703381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1ce1-f090-4780-ad45-683126ead0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:03.703664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1ce1-f090-4780-ad45-683126ead0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:03.703928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1ce1-f090-4780-ad45-683126ead0c2 None admin] PATH_INFO: `/v3/roles/59b4966b7b764eb5bc24547e4faef790` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:03.705395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b1ce1-f090-4780-ad45-683126ead0c2 None admin] RBAC: Authorizing `identity:get_role(role_id=59b4966b7b764eb5bc24547e4faef790)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:03.706775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b1ce1-f090-4780-ad45-683126ead0c2 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:03.708375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 559/1113] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:03 2022] GET /identity/v3/roles/59b4966b7b764eb5bc24547e4faef790 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:03.714915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a5da8-73f1-4d81-8c72-297dd54ad845 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:03.797471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:03.816705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a5da8-73f1-4d81-8c72-297dd54ad845 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:03.859357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb087941-4f42-4ce4-8bc7-4ddbe16cc26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:03.859992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087941-4f42-4ce4-8bc7-4ddbe16cc26b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:03.860291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087941-4f42-4ce4-8bc7-4ddbe16cc26b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:03.860561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087941-4f42-4ce4-8bc7-4ddbe16cc26b None admin] PATH_INFO: `/v3/users/8d08eda5f78742049923544c0e8e82da` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:03.874453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb087941-4f42-4ce4-8bc7-4ddbe16cc26b None admin] RBAC: Authorizing `identity:get_user(user_id=8d08eda5f78742049923544c0e8e82da)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:03.875878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb087941-4f42-4ce4-8bc7-4ddbe16cc26b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:03.877977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 555/1114] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:03 2022] GET /identity/v3/users/8d08eda5f78742049923544c0e8e82da => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:03.883635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b1ce1-f090-4780-ad45-683126ead0c2 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:03.973738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:03.989216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b1ce1-f090-4780-ad45-683126ead0c2 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:04.034523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b408d22-0d91-49a0-9688-2f302db76e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:04.035147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b408d22-0d91-49a0-9688-2f302db76e52 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:04.035483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b408d22-0d91-49a0-9688-2f302db76e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:04.035752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b408d22-0d91-49a0-9688-2f302db76e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:04.116402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b408d22-0d91-49a0-9688-2f302db76e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:04.117990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b408d22-0d91-49a0-9688-2f302db76e52 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:04.207742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:04.225517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 560/1115] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:06:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:06:04.234556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb087941-4f42-4ce4-8bc7-4ddbe16cc26b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:04.342203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb087941-4f42-4ce4-8bc7-4ddbe16cc26b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:04.380144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cd532-d029-4bcc-a532-045d6f842662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:04.381248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd532-d029-4bcc-a532-045d6f842662 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:04.381747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd532-d029-4bcc-a532-045d6f842662 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:04.382237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cd532-d029-4bcc-a532-045d6f842662 None admin] PATH_INFO: `/v3/projects/85b46495a74142c7b159bc571b18c188` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:04.384214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cd532-d029-4bcc-a532-045d6f842662 None admin] RBAC: Authorizing `identity:get_project(project_id=85b46495a74142c7b159bc571b18c188)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:04.386940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cd532-d029-4bcc-a532-045d6f842662 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:04.389995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 556/1116] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:04 2022] GET /identity/v3/projects/85b46495a74142c7b159bc571b18c188 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:06:04.397114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b408d22-0d91-49a0-9688-2f302db76e52 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:04.523670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b408d22-0d91-49a0-9688-2f302db76e52 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:04.560686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d276398-1645-4c9d-89ef-7ad80e7adf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:04.561327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276398-1645-4c9d-89ef-7ad80e7adf87 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:04.561606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276398-1645-4c9d-89ef-7ad80e7adf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:04.561882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276398-1645-4c9d-89ef-7ad80e7adf87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:04.562663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d276398-1645-4c9d-89ef-7ad80e7adf87 None admin] RBAC: Adding query filter params (role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=85b46495a74142c7b159bc571b18c188, user.id=8d08eda5f78742049923544c0e8e82da) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:04.563002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d276398-1645-4c9d-89ef-7ad80e7adf87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:04.564426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d276398-1645-4c9d-89ef-7ad80e7adf87 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:04.571798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 561/1117] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:06:04 2022] GET /identity/v3/role_assignments?user.id=8d08eda5f78742049923544c0e8e82da&scope.project.id=85b46495a74142c7b159bc571b18c188&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:06.600348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c713b-ecf4-4abf-93be-5a2a5a5ddeec None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:06.600938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c713b-ecf4-4abf-93be-5a2a5a5ddeec None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:06.600938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c713b-ecf4-4abf-93be-5a2a5a5ddeec None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:06.602296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 557/1118] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:06.609105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedec44-dfc0-4818-9923-a778b259bee0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:06.609528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedec44-dfc0-4818-9923-a778b259bee0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:06.609654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedec44-dfc0-4818-9923-a778b259bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:06.629105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-5bedec44-dfc0-4818-9923-a778b259bee0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:06.630483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5bedec44-dfc0-4818-9923-a778b259bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:06.688249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:06.709501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 562/1119] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:06:06.732339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c713b-ecf4-4abf-93be-5a2a5a5ddeec None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:06.745098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:06.850082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c713b-ecf4-4abf-93be-5a2a5a5ddeec None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:06.893783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97281d01-7057-4a07-af91-ed288c1e045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:06.894952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97281d01-7057-4a07-af91-ed288c1e045c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:06.895244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97281d01-7057-4a07-af91-ed288c1e045c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:06.895689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97281d01-7057-4a07-af91-ed288c1e045c None admin] PATH_INFO: `/v3/roles/59b4966b7b764eb5bc24547e4faef790` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:06.897545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97281d01-7057-4a07-af91-ed288c1e045c None admin] RBAC: Authorizing `identity:get_role(role_id=59b4966b7b764eb5bc24547e4faef790)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:06.899035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97281d01-7057-4a07-af91-ed288c1e045c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:06.900413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 558/1120] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:06 2022] GET /identity/v3/roles/59b4966b7b764eb5bc24547e4faef790 => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:06.906749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedec44-dfc0-4818-9923-a778b259bee0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:07.021951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedec44-dfc0-4818-9923-a778b259bee0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:07.058284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27170451-83af-4fa8-840b-ef9fbbbb4c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:07.058925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27170451-83af-4fa8-840b-ef9fbbbb4c25 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:07.059203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27170451-83af-4fa8-840b-ef9fbbbb4c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:07.059471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27170451-83af-4fa8-840b-ef9fbbbb4c25 None admin] PATH_INFO: `/v3/users/8d08eda5f78742049923544c0e8e82da` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:07.060626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27170451-83af-4fa8-840b-ef9fbbbb4c25 None admin] RBAC: Authorizing `identity:get_user(user_id=8d08eda5f78742049923544c0e8e82da)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:07.062077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27170451-83af-4fa8-840b-ef9fbbbb4c25 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:07.063673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 563/1121] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:06 2022] GET /identity/v3/users/8d08eda5f78742049923544c0e8e82da => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:07.070450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97281d01-7057-4a07-af91-ed288c1e045c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:07.165533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:07.199208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97281d01-7057-4a07-af91-ed288c1e045c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:07.235152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49701c26-64a3-4c59-93e1-fe83004ac6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:07.235777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49701c26-64a3-4c59-93e1-fe83004ac6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:07.236055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49701c26-64a3-4c59-93e1-fe83004ac6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:07.236327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49701c26-64a3-4c59-93e1-fe83004ac6c6 None admin] PATH_INFO: `/v3/projects/85b46495a74142c7b159bc571b18c188` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:07.237499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49701c26-64a3-4c59-93e1-fe83004ac6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=85b46495a74142c7b159bc571b18c188)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:07.238971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49701c26-64a3-4c59-93e1-fe83004ac6c6 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:07.240683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 559/1122] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:07 2022] GET /identity/v3/projects/85b46495a74142c7b159bc571b18c188 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:06:07.247924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27170451-83af-4fa8-840b-ef9fbbbb4c25 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:07.307344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:07.367461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27170451-83af-4fa8-840b-ef9fbbbb4c25 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:07.409434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aa671-055f-4a7a-bafa-1811f08d4463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:07.410709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa671-055f-4a7a-bafa-1811f08d4463 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:07.410986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa671-055f-4a7a-bafa-1811f08d4463 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:07.411255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa671-055f-4a7a-bafa-1811f08d4463 None admin] PATH_INFO: `/v3/projects/85b46495a74142c7b159bc571b18c188/users/8d08eda5f78742049923544c0e8e82da/roles/59b4966b7b764eb5bc24547e4faef790` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:07.413527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305aa671-055f-4a7a-bafa-1811f08d4463 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b46495a74142c7b159bc571b18c188, user_id=8d08eda5f78742049923544c0e8e82da, role_id=59b4966b7b764eb5bc24547e4faef790)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:07.414972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305aa671-055f-4a7a-bafa-1811f08d4463 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:07.491629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 564/1123] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:06:07 2022] PUT /identity/v3/projects/85b46495a74142c7b159bc571b18c188/users/8d08eda5f78742049923544c0e8e82da/roles/59b4966b7b764eb5bc24547e4faef790 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:09.591947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f42e2-9090-41a5-a717-d9d57c98c3f0 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:09.592472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f42e2-9090-41a5-a717-d9d57c98c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:09.592698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f42e2-9090-41a5-a717-d9d57c98c3f0 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:09.594943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 560/1124] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:09.602687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e640c2c-c7b2-492a-8cd6-bde6ecb6bea8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:09.603152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e640c2c-c7b2-492a-8cd6-bde6ecb6bea8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:09.603472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e640c2c-c7b2-492a-8cd6-bde6ecb6bea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:09.631573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2e640c2c-c7b2-492a-8cd6-bde6ecb6bea8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:09.632774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2e640c2c-c7b2-492a-8cd6-bde6ecb6bea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:09.711480 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 565/1125] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:09.734615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f42e2-9090-41a5-a717-d9d57c98c3f0 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:09.854060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f42e2-9090-41a5-a717-d9d57c98c3f0 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:09.891812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bc0d-d7bb-4620-95e2-8ca0e2770ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:09.892460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bc0d-d7bb-4620-95e2-8ca0e2770ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:09.892741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bc0d-d7bb-4620-95e2-8ca0e2770ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:09.893051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bc0d-d7bb-4620-95e2-8ca0e2770ba3 None admin] PATH_INFO: `/v3/roles/59b4966b7b764eb5bc24547e4faef790` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:09.895422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654bc0d-d7bb-4620-95e2-8ca0e2770ba3 None admin] RBAC: Authorizing `identity:get_role(role_id=59b4966b7b764eb5bc24547e4faef790)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:09.896833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654bc0d-d7bb-4620-95e2-8ca0e2770ba3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:09.898250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 561/1126] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:09 2022] GET /identity/v3/roles/59b4966b7b764eb5bc24547e4faef790 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:09.904774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e640c2c-c7b2-492a-8cd6-bde6ecb6bea8 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:09.948605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:10.022816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e640c2c-c7b2-492a-8cd6-bde6ecb6bea8 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:10.060829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a3ea-5f8d-4278-8251-f6298e3843ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:10.061519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a3ea-5f8d-4278-8251-f6298e3843ce None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:10.061766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a3ea-5f8d-4278-8251-f6298e3843ce None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:10.062030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4a3ea-5f8d-4278-8251-f6298e3843ce None admin] PATH_INFO: `/v3/users/8d08eda5f78742049923544c0e8e82da` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:10.063208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4a3ea-5f8d-4278-8251-f6298e3843ce None admin] RBAC: Authorizing `identity:get_user(user_id=8d08eda5f78742049923544c0e8e82da)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:10.064621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4a3ea-5f8d-4278-8251-f6298e3843ce None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:10.066465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 566/1127] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:09 2022] GET /identity/v3/users/8d08eda5f78742049923544c0e8e82da => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:10.074194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bc0d-d7bb-4620-95e2-8ca0e2770ba3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:10.088190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:10.199788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bc0d-d7bb-4620-95e2-8ca0e2770ba3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:10.237394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e876d-49d3-4596-a961-e8cdde55f824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:10.238017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e876d-49d3-4596-a961-e8cdde55f824 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:10.238310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e876d-49d3-4596-a961-e8cdde55f824 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:10.238582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e876d-49d3-4596-a961-e8cdde55f824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:10.315790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e876d-49d3-4596-a961-e8cdde55f824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:10.318069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e876d-49d3-4596-a961-e8cdde55f824 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:10.329513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:10.429877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 562/1128] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:06:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:06:10.436188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a3ea-5f8d-4278-8251-f6298e3843ce None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:10.559111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4a3ea-5f8d-4278-8251-f6298e3843ce None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:10.571697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:10.610591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4cf35-331c-4692-8f40-947b014a7260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:10.611468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4cf35-331c-4692-8f40-947b014a7260 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:10.611468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4cf35-331c-4692-8f40-947b014a7260 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:10.611745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4cf35-331c-4692-8f40-947b014a7260 None admin] PATH_INFO: `/v3/projects/85b46495a74142c7b159bc571b18c188` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:10.613075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4cf35-331c-4692-8f40-947b014a7260 None admin] RBAC: Authorizing `identity:get_project(project_id=85b46495a74142c7b159bc571b18c188)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:10.615481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4cf35-331c-4692-8f40-947b014a7260 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:10.617422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 567/1129] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:10 2022] GET /identity/v3/projects/85b46495a74142c7b159bc571b18c188 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:10.624554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e876d-49d3-4596-a961-e8cdde55f824 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:10.750975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e876d-49d3-4596-a961-e8cdde55f824 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:10.763956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:10.788032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a136b2-1a3b-4e4c-8e1f-d6968d8d1369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:10.788662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a136b2-1a3b-4e4c-8e1f-d6968d8d1369 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:10.788971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a136b2-1a3b-4e4c-8e1f-d6968d8d1369 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:10.789246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a136b2-1a3b-4e4c-8e1f-d6968d8d1369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:10.790045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a136b2-1a3b-4e4c-8e1f-d6968d8d1369 None admin] RBAC: Adding query filter params (role.id=59b4966b7b764eb5bc24547e4faef790, scope.project.id=85b46495a74142c7b159bc571b18c188, user.id=8d08eda5f78742049923544c0e8e82da) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:10.790352 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a136b2-1a3b-4e4c-8e1f-d6968d8d1369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:10.792069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a136b2-1a3b-4e4c-8e1f-d6968d8d1369 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:10.799238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 563/1130] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:06:10 2022] GET /identity/v3/role_assignments?user.id=8d08eda5f78742049923544c0e8e82da&scope.project.id=85b46495a74142c7b159bc571b18c188&role.id=59b4966b7b764eb5bc24547e4faef790 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:12.915128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5552ac-1099-472e-bcf5-621c47f466b6 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:12.915719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5552ac-1099-472e-bcf5-621c47f466b6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:12.916340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5552ac-1099-472e-bcf5-621c47f466b6 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:12.917778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 568/1131] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:12.923052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e0a76-be9d-4829-adaa-e7fc1ac9ef3a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:12.923509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e0a76-be9d-4829-adaa-e7fc1ac9ef3a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:12.923631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e0a76-be9d-4829-adaa-e7fc1ac9ef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:12.943716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-197e0a76-be9d-4829-adaa-e7fc1ac9ef3a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:12.944955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-197e0a76-be9d-4829-adaa-e7fc1ac9ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:13.015086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 564/1132] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:13.041599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5552ac-1099-472e-bcf5-621c47f466b6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:13.153128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5552ac-1099-472e-bcf5-621c47f466b6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:13.189022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ecb12-229e-4873-bede-e5303e1106d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:13.189747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecb12-229e-4873-bede-e5303e1106d6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:13.190028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecb12-229e-4873-bede-e5303e1106d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:13.190302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecb12-229e-4873-bede-e5303e1106d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:13.192212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecb12-229e-4873-bede-e5303e1106d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:13.193763 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecb12-229e-4873-bede-e5303e1106d6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:13.195378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 569/1133] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:06:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:13.201883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e0a76-be9d-4829-adaa-e7fc1ac9ef3a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:13.314887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e0a76-be9d-4829-adaa-e7fc1ac9ef3a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:13.317946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:13.354039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650b4d9-b151-4d2a-8c6d-1604e1ed3d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:13.354656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650b4d9-b151-4d2a-8c6d-1604e1ed3d84 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:13.354934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650b4d9-b151-4d2a-8c6d-1604e1ed3d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:13.355207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650b4d9-b151-4d2a-8c6d-1604e1ed3d84 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:13.355906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650b4d9-b151-4d2a-8c6d-1604e1ed3d84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:13.357392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650b4d9-b151-4d2a-8c6d-1604e1ed3d84 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:13.445435 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 565/1134] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:06:13 2022] POST /identity/v3/projects => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:06:15.609241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5f80-b4b5-4a42-b530-471d86f6c053 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:15.609909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5f80-b4b5-4a42-b530-471d86f6c053 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:15.609909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b5f80-b4b5-4a42-b530-471d86f6c053 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:15.611151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 570/1135] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:15.617933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcb66-237e-4b0c-a2e3-7b94d870b964 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:15.618535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcb66-237e-4b0c-a2e3-7b94d870b964 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:15.618883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcb66-237e-4b0c-a2e3-7b94d870b964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:15.647477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-fbcbcb66-237e-4b0c-a2e3-7b94d870b964 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:15.649458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fbcbcb66-237e-4b0c-a2e3-7b94d870b964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:15.728007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 566/1136] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:06:15.764872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b5f80-b4b5-4a42-b530-471d86f6c053 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:15.815403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:15.883611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b5f80-b4b5-4a42-b530-471d86f6c053 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:15.923897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae2f91-28ba-4778-802d-646efbe49acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:15.924596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2f91-28ba-4778-802d-646efbe49acd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:15.924948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2f91-28ba-4778-802d-646efbe49acd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:15.925260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2f91-28ba-4778-802d-646efbe49acd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:15.927179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae2f91-28ba-4778-802d-646efbe49acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:15.928739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae2f91-28ba-4778-802d-646efbe49acd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:15.930499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 571/1137] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:06:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:15.936771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcb66-237e-4b0c-a2e3-7b94d870b964 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:16.038004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:16.053823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcb66-237e-4b0c-a2e3-7b94d870b964 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:16.095075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53996a-34d2-46dc-b4c2-cd22dbb6c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:16.095806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53996a-34d2-46dc-b4c2-cd22dbb6c21b None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:16.096262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53996a-34d2-46dc-b4c2-cd22dbb6c21b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:16.096385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53996a-34d2-46dc-b4c2-cd22dbb6c21b None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:16.097062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53996a-34d2-46dc-b4c2-cd22dbb6c21b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:16.098919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53996a-34d2-46dc-b4c2-cd22dbb6c21b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:16.185827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 567/1138] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:06:15 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:06:18.352316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c474f-1af1-4c3e-9134-59b6997e1046 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:18.379647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c474f-1af1-4c3e-9134-59b6997e1046 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:18.379647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c474f-1af1-4c3e-9134-59b6997e1046 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:18.379647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 572/1139] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:18.380074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae873d-3500-4290-90f0-7dbfc79eab07 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:18.380074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae873d-3500-4290-90f0-7dbfc79eab07 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:18.380074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae873d-3500-4290-90f0-7dbfc79eab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:18.382539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-2eae873d-3500-4290-90f0-7dbfc79eab07 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:18.383864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-2eae873d-3500-4290-90f0-7dbfc79eab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:18.467748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 568/1140] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:18.492283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c474f-1af1-4c3e-9134-59b6997e1046 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:18.608253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c474f-1af1-4c3e-9134-59b6997e1046 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:18.622515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:18.660490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00df4e-2a3c-4578-9748-6bd14ffd1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:18.661637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00df4e-2a3c-4578-9748-6bd14ffd1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:18.662119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00df4e-2a3c-4578-9748-6bd14ffd1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:18.662617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00df4e-2a3c-4578-9748-6bd14ffd1ea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:18.679542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00df4e-2a3c-4578-9748-6bd14ffd1ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-2d00df4e-2a3c-4578-9748-6bd14ffd1ea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:06:18.687994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:06:18.690268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:06:18.692341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 573/1141] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:06:18.696212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae873d-3500-4290-90f0-7dbfc79eab07 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:18.772829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:18.812903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae873d-3500-4290-90f0-7dbfc79eab07 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:18.859699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:18.860294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:18.860578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:18.860858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:18.861636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:18.861977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:18.863707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:18.873153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 569/1142] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:18.880197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00df4e-2a3c-4578-9748-6bd14ffd1ea9 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:18.998549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00df4e-2a3c-4578-9748-6bd14ffd1ea9 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:19.039001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6c8c8-80a2-4305-b836-c74d23a27d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:19.039943 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6c8c8-80a2-4305-b836-c74d23a27d6c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:19.040280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6c8c8-80a2-4305-b836-c74d23a27d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:19.040550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6c8c8-80a2-4305-b836-c74d23a27d6c None admin] PATH_INFO: `/v3/users/d88306099f674753af0b1a8b1ccdd8af` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:19.056702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6c8c8-80a2-4305-b836-c74d23a27d6c None admin] RBAC: Authorizing `identity:get_user(user_id=d88306099f674753af0b1a8b1ccdd8af)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:19.058331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6c8c8-80a2-4305-b836-c74d23a27d6c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:19.060093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 574/1143] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:18 2022] GET /identity/v3/users/d88306099f674753af0b1a8b1ccdd8af => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:19.066741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:19.190614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53a274-45c2-4713-9a4f-8e0dd51f91e2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:19.232725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cf5b4-a379-4fa7-9727-181a7514a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:19.233391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf5b4-a379-4fa7-9727-181a7514a671 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:19.233670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf5b4-a379-4fa7-9727-181a7514a671 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:19.233943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf5b4-a379-4fa7-9727-181a7514a671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:19.239055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:19.338821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cf5b4-a379-4fa7-9727-181a7514a671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:19.340373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cf5b4-a379-4fa7-9727-181a7514a671 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:19.467717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 570/1144] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:06:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:06:19.477169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6c8c8-80a2-4305-b836-c74d23a27d6c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:19.517535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:19.615907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6c8c8-80a2-4305-b836-c74d23a27d6c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:19.653647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875534e5-36e8-4104-aea6-24883fdcc2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:19.654294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875534e5-36e8-4104-aea6-24883fdcc2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:19.654580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875534e5-36e8-4104-aea6-24883fdcc2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:19.654855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875534e5-36e8-4104-aea6-24883fdcc2b0 None admin] PATH_INFO: `/v3/projects/57c5ad9a5aa74decafa81cc28550207d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:19.656070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875534e5-36e8-4104-aea6-24883fdcc2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=57c5ad9a5aa74decafa81cc28550207d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:19.657551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875534e5-36e8-4104-aea6-24883fdcc2b0 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:19.659389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 575/1145] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:19 2022] GET /identity/v3/projects/57c5ad9a5aa74decafa81cc28550207d => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:19.666981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cf5b4-a379-4fa7-9727-181a7514a671 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:19.701574 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:19.780561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cf5b4-a379-4fa7-9727-181a7514a671 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:19.826532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f71849-5316-46a1-8cef-aad26898ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:19.827157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f71849-5316-46a1-8cef-aad26898ef4f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:19.827435 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f71849-5316-46a1-8cef-aad26898ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:19.827711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f71849-5316-46a1-8cef-aad26898ef4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:19.828505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f71849-5316-46a1-8cef-aad26898ef4f None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=57c5ad9a5aa74decafa81cc28550207d, user.id=d88306099f674753af0b1a8b1ccdd8af) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:19.828809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f71849-5316-46a1-8cef-aad26898ef4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:19.830314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f71849-5316-46a1-8cef-aad26898ef4f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:19.837600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 571/1146] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:06:19 2022] GET /identity/v3/role_assignments?user.id=d88306099f674753af0b1a8b1ccdd8af&scope.project.id=57c5ad9a5aa74decafa81cc28550207d&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:06:21.906619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceb6d0-a001-405d-86dd-75424a51053d None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:21.907178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceb6d0-a001-405d-86dd-75424a51053d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:21.907178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ceb6d0-a001-405d-86dd-75424a51053d None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:21.909645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 576/1147] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:21.925915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537dffd-de95-42ac-b4ac-e183c190a6f1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:21.926625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537dffd-de95-42ac-b4ac-e183c190a6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:21.926625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537dffd-de95-42ac-b4ac-e183c190a6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:21.948036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-4537dffd-de95-42ac-b4ac-e183c190a6f1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:21.949507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4537dffd-de95-42ac-b4ac-e183c190a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:22.029911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 572/1148] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:22.054313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceb6d0-a001-405d-86dd-75424a51053d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:22.158971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:22.168292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ceb6d0-a001-405d-86dd-75424a51053d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:22.210213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bb6f0-0ca1-495f-941a-95534820a964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:22.210863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bb6f0-0ca1-495f-941a-95534820a964 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:22.211142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bb6f0-0ca1-495f-941a-95534820a964 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:22.211417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bb6f0-0ca1-495f-941a-95534820a964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:22.224344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bb6f0-0ca1-495f-941a-95534820a964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-6d7bb6f0-0ca1-495f-941a-95534820a964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:06:22.229647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:06:22.230789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:06:22.231742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 577/1149] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:06:22.245452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537dffd-de95-42ac-b4ac-e183c190a6f1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:22.274325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:22.352854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537dffd-de95-42ac-b4ac-e183c190a6f1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:22.403259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:22.403870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:22.404147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:22.404419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:22.405167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:22.405473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:22.406849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:22.424653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 573/1150] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:06:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:22.425089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bb6f0-0ca1-495f-941a-95534820a964 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:22.543026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bb6f0-0ca1-495f-941a-95534820a964 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:22.585440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234dd23-ec07-4524-91f4-9a57bd005cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:22.586076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234dd23-ec07-4524-91f4-9a57bd005cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:22.586351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234dd23-ec07-4524-91f4-9a57bd005cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:22.586621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234dd23-ec07-4524-91f4-9a57bd005cf9 None admin] PATH_INFO: `/v3/users/d88306099f674753af0b1a8b1ccdd8af` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:22.587801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234dd23-ec07-4524-91f4-9a57bd005cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=d88306099f674753af0b1a8b1ccdd8af)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:22.589323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234dd23-ec07-4524-91f4-9a57bd005cf9 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:22.590924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 578/1151] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:22 2022] GET /identity/v3/users/d88306099f674753af0b1a8b1ccdd8af => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:06:22.597260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:22.713552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:22.729821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d628e6e-918d-45d5-9091-8adf99f44b7c None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:22.768390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a7741-520c-4ddf-8b83-cbbf0403fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:22.769141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7741-520c-4ddf-8b83-cbbf0403fe9d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:22.769423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7741-520c-4ddf-8b83-cbbf0403fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:22.769700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7741-520c-4ddf-8b83-cbbf0403fe9d None admin] PATH_INFO: `/v3/projects/57c5ad9a5aa74decafa81cc28550207d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:22.770984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a7741-520c-4ddf-8b83-cbbf0403fe9d None admin] RBAC: Authorizing `identity:get_project(project_id=57c5ad9a5aa74decafa81cc28550207d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:22.772435 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a7741-520c-4ddf-8b83-cbbf0403fe9d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:22.774170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 574/1152] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:22 2022] GET /identity/v3/projects/57c5ad9a5aa74decafa81cc28550207d => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:06:22.780599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234dd23-ec07-4524-91f4-9a57bd005cf9 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:22.809439 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:22.889065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234dd23-ec07-4524-91f4-9a57bd005cf9 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:22.929493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def85469-c83c-4008-b34c-da7b5a1ff480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:22.930261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def85469-c83c-4008-b34c-da7b5a1ff480 None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:22.930544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def85469-c83c-4008-b34c-da7b5a1ff480 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:22.930820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def85469-c83c-4008-b34c-da7b5a1ff480 None admin] PATH_INFO: `/v3/projects/57c5ad9a5aa74decafa81cc28550207d/users/d88306099f674753af0b1a8b1ccdd8af/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:22.933084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def85469-c83c-4008-b34c-da7b5a1ff480 None admin] RBAC: Authorizing `identity:create_grant(project_id=57c5ad9a5aa74decafa81cc28550207d, user_id=d88306099f674753af0b1a8b1ccdd8af, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:22.934534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def85469-c83c-4008-b34c-da7b5a1ff480 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:23.064265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 579/1153] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:06:22 2022] PUT /identity/v3/projects/57c5ad9a5aa74decafa81cc28550207d/users/d88306099f674753af0b1a8b1ccdd8af/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:25.105173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb9c56-cb1f-40b4-bec2-516bff6e1f14 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:25.105738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb9c56-cb1f-40b4-bec2-516bff6e1f14 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:25.105738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb9c56-cb1f-40b4-bec2-516bff6e1f14 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:25.107059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 575/1154] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:25.113286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd70cc-d13b-4d88-80a0-10cbfb4fe777 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:25.113794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd70cc-d13b-4d88-80a0-10cbfb4fe777 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:25.113895 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd70cc-d13b-4d88-80a0-10cbfb4fe777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:25.133278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cfcd70cc-d13b-4d88-80a0-10cbfb4fe777 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:25.134500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cfcd70cc-d13b-4d88-80a0-10cbfb4fe777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:25.203805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 580/1155] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:25.227721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb9c56-cb1f-40b4-bec2-516bff6e1f14 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:25.331005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb9c56-cb1f-40b4-bec2-516bff6e1f14 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:25.367103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a60b0-264d-4cdd-a761-8f173d8e8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:25.367713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a60b0-264d-4cdd-a761-8f173d8e8669 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:25.367997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a60b0-264d-4cdd-a761-8f173d8e8669 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:25.368272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a60b0-264d-4cdd-a761-8f173d8e8669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:25.379172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a60b0-264d-4cdd-a761-8f173d8e8669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-2c5a60b0-264d-4cdd-a761-8f173d8e8669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:06:25.384112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:06:25.385392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:06:25.386266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 576/1156] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:06:25.391494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd70cc-d13b-4d88-80a0-10cbfb4fe777 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:25.406560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:25.491289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd70cc-d13b-4d88-80a0-10cbfb4fe777 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:25.525900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:25.526507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:25.526784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:25.527052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:25.527749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:25.528048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:25.529421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:25.538006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 581/1157] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:06:25.544413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a60b0-264d-4cdd-a761-8f173d8e8669 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:25.564094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:25.644778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a60b0-264d-4cdd-a761-8f173d8e8669 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:25.680972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b303b6c-aaec-49ea-adf5-7d8366f8a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:25.681615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b303b6c-aaec-49ea-adf5-7d8366f8a956 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:25.681897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b303b6c-aaec-49ea-adf5-7d8366f8a956 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:25.682172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b303b6c-aaec-49ea-adf5-7d8366f8a956 None admin] PATH_INFO: `/v3/users/d88306099f674753af0b1a8b1ccdd8af` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:25.683424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b303b6c-aaec-49ea-adf5-7d8366f8a956 None admin] RBAC: Authorizing `identity:get_user(user_id=d88306099f674753af0b1a8b1ccdd8af)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:25.684871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b303b6c-aaec-49ea-adf5-7d8366f8a956 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:25.686518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 577/1158] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:25 2022] GET /identity/v3/users/d88306099f674753af0b1a8b1ccdd8af => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:25.692568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:25.779017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:25.802036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e733fe-23cf-4b6d-bb66-402c40c6211b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:25.837101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220142c5-d29f-40a9-8d3e-04ddf9e22446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:25.837747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220142c5-d29f-40a9-8d3e-04ddf9e22446 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:25.838031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220142c5-d29f-40a9-8d3e-04ddf9e22446 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:25.838303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220142c5-d29f-40a9-8d3e-04ddf9e22446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:25.910694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220142c5-d29f-40a9-8d3e-04ddf9e22446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:25.912048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220142c5-d29f-40a9-8d3e-04ddf9e22446 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:25.989010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:26.012204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 582/1159] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:06:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:06:26.018601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b303b6c-aaec-49ea-adf5-7d8366f8a956 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:26.118985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:26.137581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b303b6c-aaec-49ea-adf5-7d8366f8a956 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:26.178053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e43479-cf75-436d-b842-b24b941491cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:26.178620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e43479-cf75-436d-b842-b24b941491cc None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:26.178904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e43479-cf75-436d-b842-b24b941491cc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:26.179180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e43479-cf75-436d-b842-b24b941491cc None admin] PATH_INFO: `/v3/projects/57c5ad9a5aa74decafa81cc28550207d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:26.180586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e43479-cf75-436d-b842-b24b941491cc None admin] RBAC: Authorizing `identity:get_project(project_id=57c5ad9a5aa74decafa81cc28550207d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:26.182599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e43479-cf75-436d-b842-b24b941491cc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:26.184309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 578/1160] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:26 2022] GET /identity/v3/projects/57c5ad9a5aa74decafa81cc28550207d => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:26.191687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220142c5-d29f-40a9-8d3e-04ddf9e22446 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:26.313022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220142c5-d29f-40a9-8d3e-04ddf9e22446 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:26.353394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd50663-43e3-4798-9d3b-66cd44b94915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:26.354011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50663-43e3-4798-9d3b-66cd44b94915 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:26.354312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50663-43e3-4798-9d3b-66cd44b94915 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:26.354565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50663-43e3-4798-9d3b-66cd44b94915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:26.355340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd50663-43e3-4798-9d3b-66cd44b94915 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=57c5ad9a5aa74decafa81cc28550207d, user.id=d88306099f674753af0b1a8b1ccdd8af) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:26.355644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd50663-43e3-4798-9d3b-66cd44b94915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:26.357138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd50663-43e3-4798-9d3b-66cd44b94915 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:26.363327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 583/1161] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:06:26 2022] GET /identity/v3/role_assignments?user.id=d88306099f674753af0b1a8b1ccdd8af&scope.project.id=57c5ad9a5aa74decafa81cc28550207d&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:28.466343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ef62-4c22-4599-987c-0af9a86ca5da None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:28.466888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ef62-4c22-4599-987c-0af9a86ca5da None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:28.466888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ef62-4c22-4599-987c-0af9a86ca5da None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:28.468241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 579/1162] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:28.474814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b745-5e14-40eb-9226-615291387ac4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:28.475525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b745-5e14-40eb-9226-615291387ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:28.475800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b745-5e14-40eb-9226-615291387ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:28.494523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0714b745-5e14-40eb-9226-615291387ac4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:28.495702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0714b745-5e14-40eb-9226-615291387ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:28.530801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:28.567185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 584/1163] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:06:28.589547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ef62-4c22-4599-987c-0af9a86ca5da None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:28.697020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ef62-4c22-4599-987c-0af9a86ca5da None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:28.733510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c3714-e7dc-44bd-8713-2f8325160330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:28.734044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3714-e7dc-44bd-8713-2f8325160330 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:28.734322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3714-e7dc-44bd-8713-2f8325160330 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:28.734594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3714-e7dc-44bd-8713-2f8325160330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:28.760113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:28.811032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c3714-e7dc-44bd-8713-2f8325160330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:28.812503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c3714-e7dc-44bd-8713-2f8325160330 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:28.919779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 580/1164] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:06:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:06:28.926569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714b745-5e14-40eb-9226-615291387ac4 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:29.040912 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714b745-5e14-40eb-9226-615291387ac4 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:29.082720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb4f7c-793c-4406-9c36-5281c4c083b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:29.083348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4f7c-793c-4406-9c36-5281c4c083b5 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:29.083622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4f7c-793c-4406-9c36-5281c4c083b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:29.083891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4f7c-793c-4406-9c36-5281c4c083b5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:29.091282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb4f7c-793c-4406-9c36-5281c4c083b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:29.093034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb4f7c-793c-4406-9c36-5281c4c083b5 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-0cdb4f7c-793c-4406-9c36-5281c4c083b5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:06:29.108004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:06:29.109227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 21:06:29.110083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:06:29.113288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 585/1165] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:06:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:06:29.118487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c3714-e7dc-44bd-8713-2f8325160330 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:29.185496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:29.254513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c3714-e7dc-44bd-8713-2f8325160330 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:29.302272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb58103-4518-4f80-aefc-1c75fad3420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:29.302809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb58103-4518-4f80-aefc-1c75fad3420a None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:29.303165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb58103-4518-4f80-aefc-1c75fad3420a None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:29.303453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb58103-4518-4f80-aefc-1c75fad3420a None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:29.304159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb58103-4518-4f80-aefc-1c75fad3420a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:29.304458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb58103-4518-4f80-aefc-1c75fad3420a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:29.305899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb58103-4518-4f80-aefc-1c75fad3420a None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:29.315068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 581/1166] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Aug 4 21:06:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:31.336098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517286-7989-4922-ae1d-478fd2c3c386 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:31.336712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517286-7989-4922-ae1d-478fd2c3c386 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:31.336712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517286-7989-4922-ae1d-478fd2c3c386 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:31.338033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 586/1167] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:31.343615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32637e-f8f0-4e66-a8e6-4c7975ba8c30 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:31.344083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32637e-f8f0-4e66-a8e6-4c7975ba8c30 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:31.344190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32637e-f8f0-4e66-a8e6-4c7975ba8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:31.363123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ed32637e-f8f0-4e66-a8e6-4c7975ba8c30 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:31.364506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ed32637e-f8f0-4e66-a8e6-4c7975ba8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:31.436511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 582/1168] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:06:31.459331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517286-7989-4922-ae1d-478fd2c3c386 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:31.491103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:31.564567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517286-7989-4922-ae1d-478fd2c3c386 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:31.598311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3827b49-afcb-471b-8698-2bb825faf72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:31.598836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3827b49-afcb-471b-8698-2bb825faf72b None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:31.599110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3827b49-afcb-471b-8698-2bb825faf72b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:31.599379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3827b49-afcb-471b-8698-2bb825faf72b None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:31.600070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3827b49-afcb-471b-8698-2bb825faf72b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:31.601448 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3827b49-afcb-471b-8698-2bb825faf72b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:31.708214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 587/1169] 10.222.0.93 () {60 vars in 1138 bytes} [Thu Aug 4 21:06:31 2022] POST /identity/v3/domains => generated 267 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:06:33.782832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cabde-f37c-44a8-9aa2-2528d1ed42d9 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:33.783410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cabde-f37c-44a8-9aa2-2528d1ed42d9 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:33.783410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cabde-f37c-44a8-9aa2-2528d1ed42d9 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:33.784763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 583/1170] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:33.790280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db437b-78fd-4b09-948c-6217e5c8d93d None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:33.791004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db437b-78fd-4b09-948c-6217e5c8d93d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:33.791105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db437b-78fd-4b09-948c-6217e5c8d93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:33.809066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-33db437b-78fd-4b09-948c-6217e5c8d93d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:33.810262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-33db437b-78fd-4b09-948c-6217e5c8d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:33.878587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 588/1171] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:33.905391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cabde-f37c-44a8-9aa2-2528d1ed42d9 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:33.959342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:34.016390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cabde-f37c-44a8-9aa2-2528d1ed42d9 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:34.052507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d43f84-85d4-4850-9afe-9394077bda15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:34.053115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d43f84-85d4-4850-9afe-9394077bda15 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:34.053402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d43f84-85d4-4850-9afe-9394077bda15 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:34.053681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d43f84-85d4-4850-9afe-9394077bda15 None admin] PATH_INFO: `/v3/domains/63a26a05774246109ecf18d0578077cc` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:34.065523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d43f84-85d4-4850-9afe-9394077bda15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=63a26a05774246109ecf18d0578077cc)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:34.067118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d43f84-85d4-4850-9afe-9394077bda15 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:34.068797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 584/1172] 10.222.0.93 () {56 vars in 1183 bytes} [Thu Aug 4 21:06:33 2022] GET /identity/v3/domains/63a26a05774246109ecf18d0578077cc => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:34.077568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db437b-78fd-4b09-948c-6217e5c8d93d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:34.100217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:34.191009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db437b-78fd-4b09-948c-6217e5c8d93d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:34.226108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fcfb2-67e4-4004-913d-d11641f0be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:34.226719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcfb2-67e4-4004-913d-d11641f0be59 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:34.226999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcfb2-67e4-4004-913d-d11641f0be59 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:34.227270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcfb2-67e4-4004-913d-d11641f0be59 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:34.228918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fcfb2-67e4-4004-913d-d11641f0be59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:34.229461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fcfb2-67e4-4004-913d-d11641f0be59 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:34.341225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 589/1173] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:06:34 2022] POST /identity/v3/projects => generated 361 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:06:36.445039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121994b-684d-4a41-918c-b579942209d1 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:36.445633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121994b-684d-4a41-918c-b579942209d1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:36.445633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121994b-684d-4a41-918c-b579942209d1 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:36.446929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 585/1174] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:06:36.453454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462c22-2651-4674-af9e-94403848f7a9 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:36.453982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462c22-2651-4674-af9e-94403848f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:36.454384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462c22-2651-4674-af9e-94403848f7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:36.480341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2b462c22-2651-4674-af9e-94403848f7a9 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:36.481582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2b462c22-2651-4674-af9e-94403848f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:36.556862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 590/1175] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:36.583313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121994b-684d-4a41-918c-b579942209d1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:36.691611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121994b-684d-4a41-918c-b579942209d1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:36.700490 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:36.726248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc7cc0-8f9e-4534-aef9-3011a631c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:36.726883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc7cc0-8f9e-4534-aef9-3011a631c124 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:36.727186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc7cc0-8f9e-4534-aef9-3011a631c124 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:36.727469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc7cc0-8f9e-4534-aef9-3011a631c124 None admin] PATH_INFO: `/v3/domains/63a26a05774246109ecf18d0578077cc` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:36.728987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc7cc0-8f9e-4534-aef9-3011a631c124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=63a26a05774246109ecf18d0578077cc)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:36.730701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc7cc0-8f9e-4534-aef9-3011a631c124 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:36.732272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 586/1176] 10.222.0.93 () {56 vars in 1183 bytes} [Thu Aug 4 21:06:36 2022] GET /identity/v3/domains/63a26a05774246109ecf18d0578077cc => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:36.738441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462c22-2651-4674-af9e-94403848f7a9 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:36.740612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:36.848757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462c22-2651-4674-af9e-94403848f7a9 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:36.884044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65b0d6-a6d0-4c34-af98-d0a7f1fb3d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:36.884652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b0d6-a6d0-4c34-af98-d0a7f1fb3d5d None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:36.884972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b0d6-a6d0-4c34-af98-d0a7f1fb3d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:36.885232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b0d6-a6d0-4c34-af98-d0a7f1fb3d5d None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:36.885919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65b0d6-a6d0-4c34-af98-d0a7f1fb3d5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:36.887416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65b0d6-a6d0-4c34-af98-d0a7f1fb3d5d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:36.969048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 591/1177] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:06:36 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:06:39.031209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea13f-f59e-4018-afd3-2b1271472f53 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:39.031912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea13f-f59e-4018-afd3-2b1271472f53 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:39.031912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bea13f-f59e-4018-afd3-2b1271472f53 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:39.033168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 587/1178] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:39.039097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56331f-7760-42e3-bf49-53869e44eb90 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:39.039522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56331f-7760-42e3-bf49-53869e44eb90 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:39.039643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56331f-7760-42e3-bf49-53869e44eb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:39.058934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-fc56331f-7760-42e3-bf49-53869e44eb90 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:39.060123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fc56331f-7760-42e3-bf49-53869e44eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:39.124597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:39.138341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 592/1179] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:39.163464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bea13f-f59e-4018-afd3-2b1271472f53 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:39.270330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bea13f-f59e-4018-afd3-2b1271472f53 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:39.308078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b93f8c-68fb-4d71-98ad-92a613270b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:39.308603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93f8c-68fb-4d71-98ad-92a613270b7f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:39.308912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93f8c-68fb-4d71-98ad-92a613270b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:39.309174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93f8c-68fb-4d71-98ad-92a613270b7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:39.320136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b93f8c-68fb-4d71-98ad-92a613270b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-06b93f8c-68fb-4d71-98ad-92a613270b7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:06:39.325044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:06:39.326156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:06:39.327483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 588/1180] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:06:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:06:39.332826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56331f-7760-42e3-bf49-53869e44eb90 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:39.438762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56331f-7760-42e3-bf49-53869e44eb90 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:39.477483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:39.478096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:39.478370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:39.478637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:39.479337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:39.479637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:39.481010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:39.490007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 593/1181] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:06:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:39.498705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b93f8c-68fb-4d71-98ad-92a613270b7f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:39.539891 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:39.607872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b93f8c-68fb-4d71-98ad-92a613270b7f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:39.645059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d962c-4796-4d99-a3df-a1f26af6976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:39.645742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d962c-4796-4d99-a3df-a1f26af6976f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:39.646053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d962c-4796-4d99-a3df-a1f26af6976f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:39.646312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d962c-4796-4d99-a3df-a1f26af6976f None admin] PATH_INFO: `/v3/users/8647acef2bd24d54bd7cbc0654379587` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:39.661842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d962c-4796-4d99-a3df-a1f26af6976f None admin] RBAC: Authorizing `identity:get_user(user_id=8647acef2bd24d54bd7cbc0654379587)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:39.663318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d962c-4796-4d99-a3df-a1f26af6976f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:39.665027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 589/1182] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:39 2022] GET /identity/v3/users/8647acef2bd24d54bd7cbc0654379587 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:39.675229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:39.726772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:39.779063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6707-0e58-4521-b5c7-e3099af9d170 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:39.816747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f85cc-720c-407d-a103-ee61c7597a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:39.817725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f85cc-720c-407d-a103-ee61c7597a4f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:39.818087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f85cc-720c-407d-a103-ee61c7597a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:39.818446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f85cc-720c-407d-a103-ee61c7597a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:39.912299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f85cc-720c-407d-a103-ee61c7597a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:39.913712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f85cc-720c-407d-a103-ee61c7597a4f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:39.974081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:40.042582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 594/1183] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:06:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:06:40.050234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d962c-4796-4d99-a3df-a1f26af6976f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:40.152807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:40.160009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d962c-4796-4d99-a3df-a1f26af6976f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:40.197159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ead1c-819b-4eb9-b6ca-84157a8e1e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:40.197716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ead1c-819b-4eb9-b6ca-84157a8e1e4c None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:40.197990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ead1c-819b-4eb9-b6ca-84157a8e1e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:40.198259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ead1c-819b-4eb9-b6ca-84157a8e1e4c None admin] PATH_INFO: `/v3/projects/d8b1ad63c62a4417976f537b01539455` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:40.199428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ead1c-819b-4eb9-b6ca-84157a8e1e4c None admin] RBAC: Authorizing `identity:get_project(project_id=d8b1ad63c62a4417976f537b01539455)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:40.200860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ead1c-819b-4eb9-b6ca-84157a8e1e4c None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:40.202546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 590/1184] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:40 2022] GET /identity/v3/projects/d8b1ad63c62a4417976f537b01539455 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:40.209749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f85cc-720c-407d-a103-ee61c7597a4f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:40.318246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f85cc-720c-407d-a103-ee61c7597a4f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:40.360085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555580-3b6d-4da8-8205-f1d08e8d1e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:40.360813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555580-3b6d-4da8-8205-f1d08e8d1e5b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:40.361218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555580-3b6d-4da8-8205-f1d08e8d1e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:40.361487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555580-3b6d-4da8-8205-f1d08e8d1e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:40.362316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555580-3b6d-4da8-8205-f1d08e8d1e5b None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=d8b1ad63c62a4417976f537b01539455, user.id=8647acef2bd24d54bd7cbc0654379587) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:40.362614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555580-3b6d-4da8-8205-f1d08e8d1e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:40.364144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555580-3b6d-4da8-8205-f1d08e8d1e5b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:40.376479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 595/1185] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:06:40 2022] GET /identity/v3/role_assignments?user.id=8647acef2bd24d54bd7cbc0654379587&scope.project.id=d8b1ad63c62a4417976f537b01539455&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:42.415035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ab819-c087-444f-b56d-038e46b0f363 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:42.416096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ab819-c087-444f-b56d-038e46b0f363 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:42.416249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ab819-c087-444f-b56d-038e46b0f363 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:42.418037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 591/1186] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:06:42.434814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118a5c-9cf9-4761-8d09-e4f1d8cae607 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:42.435594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118a5c-9cf9-4761-8d09-e4f1d8cae607 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:42.435751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118a5c-9cf9-4761-8d09-e4f1d8cae607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:42.463840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-47118a5c-9cf9-4761-8d09-e4f1d8cae607 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:42.465100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-47118a5c-9cf9-4761-8d09-e4f1d8cae607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:42.476268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:42.563133 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 596/1187] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:42.586480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ab819-c087-444f-b56d-038e46b0f363 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:42.730128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ab819-c087-444f-b56d-038e46b0f363 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:42.766713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ecfad-cc83-47b7-9ba4-d76b0ade5c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:42.767356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ecfad-cc83-47b7-9ba4-d76b0ade5c4b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:42.767635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ecfad-cc83-47b7-9ba4-d76b0ade5c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:42.767911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ecfad-cc83-47b7-9ba4-d76b0ade5c4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:42.780590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ecfad-cc83-47b7-9ba4-d76b0ade5c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-901ecfad-cc83-47b7-9ba4-d76b0ade5c4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:06:42.785993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:06:42.787139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:06:42.788163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 592/1188] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:06:42.793712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47118a5c-9cf9-4761-8d09-e4f1d8cae607 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:42.919616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47118a5c-9cf9-4761-8d09-e4f1d8cae607 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:42.957258 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:42.957871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:42.958142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:42.958409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:42.959205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:42.959501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:42.960860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:42.969554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 597/1189] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:42.976263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ecfad-cc83-47b7-9ba4-d76b0ade5c4b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:43.009635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:43.096783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ecfad-cc83-47b7-9ba4-d76b0ade5c4b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:43.135549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036487a-7591-46c9-be1b-39d823a275e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:43.136186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036487a-7591-46c9-be1b-39d823a275e8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:43.136552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036487a-7591-46c9-be1b-39d823a275e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:43.136831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036487a-7591-46c9-be1b-39d823a275e8 None admin] PATH_INFO: `/v3/users/8647acef2bd24d54bd7cbc0654379587` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:43.138043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036487a-7591-46c9-be1b-39d823a275e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8647acef2bd24d54bd7cbc0654379587)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:43.139468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036487a-7591-46c9-be1b-39d823a275e8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:43.141156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 593/1190] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:42 2022] GET /identity/v3/users/8647acef2bd24d54bd7cbc0654379587 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:43.148596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:43.162595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:43.298337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28d3d1-9200-4b8e-92eb-cd7b57697ead None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:43.343842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d4c3-b76a-4dd1-9492-6d0dd77e39cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:43.344533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d4c3-b76a-4dd1-9492-6d0dd77e39cd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:43.344928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d4c3-b76a-4dd1-9492-6d0dd77e39cd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:43.345189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d4c3-b76a-4dd1-9492-6d0dd77e39cd None admin] PATH_INFO: `/v3/projects/d8b1ad63c62a4417976f537b01539455` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:43.346951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201d4c3-b76a-4dd1-9492-6d0dd77e39cd None admin] RBAC: Authorizing `identity:get_project(project_id=d8b1ad63c62a4417976f537b01539455)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:43.348716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201d4c3-b76a-4dd1-9492-6d0dd77e39cd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:43.350428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 598/1191] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:43 2022] GET /identity/v3/projects/d8b1ad63c62a4417976f537b01539455 => generated 361 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:43.356777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036487a-7591-46c9-be1b-39d823a275e8 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:43.452022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:43.462095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036487a-7591-46c9-be1b-39d823a275e8 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:43.502722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243b039-e9bb-4f34-a979-1960777fd4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:43.503443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243b039-e9bb-4f34-a979-1960777fd4bf None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:43.503727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243b039-e9bb-4f34-a979-1960777fd4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:43.504125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243b039-e9bb-4f34-a979-1960777fd4bf None admin] PATH_INFO: `/v3/projects/d8b1ad63c62a4417976f537b01539455/users/8647acef2bd24d54bd7cbc0654379587/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:43.506455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243b039-e9bb-4f34-a979-1960777fd4bf None admin] RBAC: Authorizing `identity:create_grant(project_id=d8b1ad63c62a4417976f537b01539455, user_id=8647acef2bd24d54bd7cbc0654379587, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:43.507981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243b039-e9bb-4f34-a979-1960777fd4bf None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:43.603634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 594/1192] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:06:43 2022] PUT /identity/v3/projects/d8b1ad63c62a4417976f537b01539455/users/8647acef2bd24d54bd7cbc0654379587/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:45.698225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa370daf-cb9e-41ac-8bc8-369822712b1d None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:45.698756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa370daf-cb9e-41ac-8bc8-369822712b1d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:45.698874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa370daf-cb9e-41ac-8bc8-369822712b1d None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:45.700360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 599/1193] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:06:45.707095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535763b6-b437-46c3-909b-5f752bbd0d10 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:45.707635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535763b6-b437-46c3-909b-5f752bbd0d10 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:45.707635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535763b6-b437-46c3-909b-5f752bbd0d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:45.726111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-535763b6-b437-46c3-909b-5f752bbd0d10 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:45.727338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-535763b6-b437-46c3-909b-5f752bbd0d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:45.806774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 595/1194] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:06:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:06:45.832973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa370daf-cb9e-41ac-8bc8-369822712b1d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:45.921954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:45.949989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa370daf-cb9e-41ac-8bc8-369822712b1d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:45.985684 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de678-e470-4286-a849-1d5afef25e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:45.986313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de678-e470-4286-a849-1d5afef25e1f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:45.986583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de678-e470-4286-a849-1d5afef25e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:45.987346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de678-e470-4286-a849-1d5afef25e1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:45.998669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de678-e470-4286-a849-1d5afef25e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-2e9de678-e470-4286-a849-1d5afef25e1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:06:46.004858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:06:46.006836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:06:46.008543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 600/1195] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:06:46.013169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535763b6-b437-46c3-909b-5f752bbd0d10 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:46.111258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:46.134973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535763b6-b437-46c3-909b-5f752bbd0d10 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:46.187955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:46.188575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:46.188848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:46.189156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:46.189918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:46.190773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:46.192152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:46.200756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 596/1196] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:46.207343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de678-e470-4286-a849-1d5afef25e1f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:46.321001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de678-e470-4286-a849-1d5afef25e1f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:46.361161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714158f-a73c-4c07-b16f-a1b3f465f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:46.365170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714158f-a73c-4c07-b16f-a1b3f465f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:46.365170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714158f-a73c-4c07-b16f-a1b3f465f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:46.365170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714158f-a73c-4c07-b16f-a1b3f465f6f8 None admin] PATH_INFO: `/v3/users/8647acef2bd24d54bd7cbc0654379587` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:46.365170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714158f-a73c-4c07-b16f-a1b3f465f6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=8647acef2bd24d54bd7cbc0654379587)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:46.365543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714158f-a73c-4c07-b16f-a1b3f465f6f8 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:46.366969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 601/1197] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Aug 4 21:06:46 2022] GET /identity/v3/users/8647acef2bd24d54bd7cbc0654379587 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:46.372912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:46.490439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f615a-92b0-403d-8b35-f735c06b22da None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:46.536184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49736af8-16ca-4439-b88f-86a661b8d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:46.536798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49736af8-16ca-4439-b88f-86a661b8d420 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:46.537103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49736af8-16ca-4439-b88f-86a661b8d420 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:46.537374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49736af8-16ca-4439-b88f-86a661b8d420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:46.550668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:46.625930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49736af8-16ca-4439-b88f-86a661b8d420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:46.627311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49736af8-16ca-4439-b88f-86a661b8d420 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:46.732518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 597/1198] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:06:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:06:46.739065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714158f-a73c-4c07-b16f-a1b3f465f6f8 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:46.742153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:46.849265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714158f-a73c-4c07-b16f-a1b3f465f6f8 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:46.898080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb192b-782a-44e5-9f4f-38a03ee0dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:46.898630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb192b-782a-44e5-9f4f-38a03ee0dd2d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:46.898906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb192b-782a-44e5-9f4f-38a03ee0dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:46.899171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb192b-782a-44e5-9f4f-38a03ee0dd2d None admin] PATH_INFO: `/v3/projects/d8b1ad63c62a4417976f537b01539455` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:46.900329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb192b-782a-44e5-9f4f-38a03ee0dd2d None admin] RBAC: Authorizing `identity:get_project(project_id=d8b1ad63c62a4417976f537b01539455)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:46.901779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb192b-782a-44e5-9f4f-38a03ee0dd2d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:46.903414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 602/1199] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Aug 4 21:06:46 2022] GET /identity/v3/projects/d8b1ad63c62a4417976f537b01539455 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:46.910625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49736af8-16ca-4439-b88f-86a661b8d420 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:46.958979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:47.024285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49736af8-16ca-4439-b88f-86a661b8d420 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:47.062634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d778079-929f-426f-8e65-6330b452c151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:47.063238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778079-929f-426f-8e65-6330b452c151 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:47.063514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778079-929f-426f-8e65-6330b452c151 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:47.063796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778079-929f-426f-8e65-6330b452c151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:47.064578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778079-929f-426f-8e65-6330b452c151 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=d8b1ad63c62a4417976f537b01539455, user.id=8647acef2bd24d54bd7cbc0654379587) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:47.065535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778079-929f-426f-8e65-6330b452c151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:47.067163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778079-929f-426f-8e65-6330b452c151 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:47.073465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 598/1200] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:06:46 2022] GET /identity/v3/role_assignments?user.id=8647acef2bd24d54bd7cbc0654379587&scope.project.id=d8b1ad63c62a4417976f537b01539455&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:56.893680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=65 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:57.070608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=47 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:04.680775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234466-a212-444a-99c6-8bfe7dd5f158 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:04.681404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234466-a212-444a-99c6-8bfe7dd5f158 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:04.681404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234466-a212-444a-99c6-8bfe7dd5f158 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:04.682696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 603/1201] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:08:04.689206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef588f-38ef-4bf8-8d87-4f1539d67d8a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:04.689672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef588f-38ef-4bf8-8d87-4f1539d67d8a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:04.689781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef588f-38ef-4bf8-8d87-4f1539d67d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:04.708716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b8ef588f-38ef-4bf8-8d87-4f1539d67d8a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:04.709903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b8ef588f-38ef-4bf8-8d87-4f1539d67d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:04.782698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 599/1202] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:08:04.808291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39234466-a212-444a-99c6-8bfe7dd5f158 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:04.929797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39234466-a212-444a-99c6-8bfe7dd5f158 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:04.968979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:04.969633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:04.970104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:04.970365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:04.983041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:04.985508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:05.001582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:05.002714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:05.004305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:05.004305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:05.004305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:05.004305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:05.004305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 604/1203] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:05.014447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef588f-38ef-4bf8-8d87-4f1539d67d8a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:05.130204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef588f-38ef-4bf8-8d87-4f1539d67d8a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:05.164601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:05.170812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728a8aa-808f-432e-b35a-42cab97c7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:05.175379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a8aa-808f-432e-b35a-42cab97c7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:05.175379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a8aa-808f-432e-b35a-42cab97c7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:05.175379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a8aa-808f-432e-b35a-42cab97c7fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:05.175379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a8aa-808f-432e-b35a-42cab97c7fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:05.175379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a8aa-808f-432e-b35a-42cab97c7fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:05.175379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a8aa-808f-432e-b35a-42cab97c7fb7 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:05.188096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 600/1204] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:05.194206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:05.258549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:05.314333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9470-0f54-44df-a53d-af3fafb72e8d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:05.352358 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7e590-bf7d-458b-8773-5eb71c0de52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:05.353003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7e590-bf7d-458b-8773-5eb71c0de52e None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:05.353283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7e590-bf7d-458b-8773-5eb71c0de52e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:05.353543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7e590-bf7d-458b-8773-5eb71c0de52e None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:05.354212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7e590-bf7d-458b-8773-5eb71c0de52e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:05.355623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7e590-bf7d-458b-8773-5eb71c0de52e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:05.496195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 605/1205] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Aug 4 21:08:05 2022] POST /identity/v3/users => generated 251 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:08:07.636137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8666-1ca4-4cab-9292-0f6749f86885 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:07.636937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8666-1ca4-4cab-9292-0f6749f86885 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:07.636937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8666-1ca4-4cab-9292-0f6749f86885 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:07.638069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 601/1206] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:07.643791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d99376-f8dd-45e5-a912-f9990c93625d None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:07.644331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d99376-f8dd-45e5-a912-f9990c93625d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:07.644477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d99376-f8dd-45e5-a912-f9990c93625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:07.664535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-31d99376-f8dd-45e5-a912-f9990c93625d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:07.665833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-31d99376-f8dd-45e5-a912-f9990c93625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:07.750470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 606/1207] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:08:07.777173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f8666-1ca4-4cab-9292-0f6749f86885 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:07.892576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f8666-1ca4-4cab-9292-0f6749f86885 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:07.936237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf80d3-9a83-4674-b109-9192cbbd8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:07.936928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf80d3-9a83-4674-b109-9192cbbd8be2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:07.937225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf80d3-9a83-4674-b109-9192cbbd8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:07.937500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf80d3-9a83-4674-b109-9192cbbd8be2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:07.951511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf80d3-9a83-4674-b109-9192cbbd8be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-62bf80d3-9a83-4674-b109-9192cbbd8be2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:08:07.955677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:07.957449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:07.959043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 602/1208] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:08:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:07.963000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d99376-f8dd-45e5-a912-f9990c93625d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:08.006268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:08.086971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d99376-f8dd-45e5-a912-f9990c93625d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:08.124164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:08.125058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:08.125388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:08.125683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:08.126441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:08.126742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:08.128125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:08.136686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 607/1209] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:08:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:08.143363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf80d3-9a83-4674-b109-9192cbbd8be2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:08.204168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:08.256294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf80d3-9a83-4674-b109-9192cbbd8be2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:08.293594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:08.294798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:08.295198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:08.295474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:08.314567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:08.317372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:08.336620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:08.337886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:08.338814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:08.338814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:08.338814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:08.338814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:08.338814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 603/1210] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:08.344417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:08.477653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:08.480791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471abae-01fe-4bd7-8784-7caae84dd24e None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:08.520794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:08.521451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:08.521730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:08.522002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:08.522690 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:08.523020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:08.524388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:08.537691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 608/1211] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:08.545032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:08.666799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f33b5-8ae3-4518-8ff9-98ef35e5b5b6 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:08.668280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:08.704335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:08.705137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:08.705420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:08.705697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:08.713838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:08.715414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:08:08.727840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:08.728920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:08.730065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 604/1212] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:08:08.735207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:08.866994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c9fc7-7e81-48eb-ae1b-6a299e76fd9b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:08.904792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:08.905443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:08.906294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:08.906587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:08.907494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:08.907795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:08.909292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:08.933735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 609/1213] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Aug 4 21:08:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:08.939603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:09.066682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5eb1-af8f-4368-ba78-5666d762edf2 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:09.104708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d2d8-61ce-43e6-9059-b9e138c1336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:09.105369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d2d8-61ce-43e6-9059-b9e138c1336b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:09.105646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d2d8-61ce-43e6-9059-b9e138c1336b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:09.105915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d2d8-61ce-43e6-9059-b9e138c1336b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:09.143327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:09.191575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874d2d8-61ce-43e6-9059-b9e138c1336b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:09.193033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874d2d8-61ce-43e6-9059-b9e138c1336b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:09.305134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 605/1214] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:08:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 21:08:09.312128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:09.340611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:09.437743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9dd1f-526b-4b61-b80f-3ae027e0ba8f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:09.476113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:09.476679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:09.477072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:09.477237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:09.488628 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:09.490174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:09.506549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:09.507634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:09.508747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:09.508747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:09.508747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:09.508747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:09.508747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 610/1215] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:09.514023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d2d8-61ce-43e6-9059-b9e138c1336b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:09.582136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:09.623717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d2d8-61ce-43e6-9059-b9e138c1336b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:09.664217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:09.664917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:09.665195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:09.665489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:09.666181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:09.666481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:09.667903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:09.680291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 606/1216] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:09.686146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:09.763562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:09.799251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5729a3-5140-4f1d-b243-5736e3ff8513 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:09.834865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:09.835512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:09.835787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:09.836060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:09.842814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:09.844496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:08:09.856465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:09.862420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:09.863354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 611/1217] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:09.864046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:09.971589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3db4f-ed33-45ab-a685-2c14b31cf05f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:10.002361 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:10.015235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a910a2e-7127-400b-8c81-262a78d6420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:10.016016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a910a2e-7127-400b-8c81-262a78d6420f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:10.016296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a910a2e-7127-400b-8c81-262a78d6420f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:10.016643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a910a2e-7127-400b-8c81-262a78d6420f None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:10.018413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a910a2e-7127-400b-8c81-262a78d6420f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:10.018970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a910a2e-7127-400b-8c81-262a78d6420f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:10.021521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a910a2e-7127-400b-8c81-262a78d6420f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:10.035219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 607/1218] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:10.048036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:10.187512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bf9db-4a10-4384-9056-f1e277774a90 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:10.228488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:10.235227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ff6ba-fb5f-4e7c-b07a-ebabbc24c550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:10.235752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff6ba-fb5f-4e7c-b07a-ebabbc24c550 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:10.236025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff6ba-fb5f-4e7c-b07a-ebabbc24c550 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:10.236310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ff6ba-fb5f-4e7c-b07a-ebabbc24c550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:10.237124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ff6ba-fb5f-4e7c-b07a-ebabbc24c550 None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=afab8bad046e462b9bd6188fa01720d0) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:10.237426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ff6ba-fb5f-4e7c-b07a-ebabbc24c550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:10.238882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ff6ba-fb5f-4e7c-b07a-ebabbc24c550 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:10.244741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 612/1219] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:08:10 2022] GET /identity/v3/role_assignments?user.id=afab8bad046e462b9bd6188fa01720d0&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:12.305946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7b96-2f02-4f73-af9f-04292b10dee5 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.306489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7b96-2f02-4f73-af9f-04292b10dee5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.306879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7b96-2f02-4f73-af9f-04292b10dee5 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.308987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 608/1220] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:12.315031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fbc24-2400-46fe-ace6-4c92cbbbe176 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.315585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fbc24-2400-46fe-ace6-4c92cbbbe176 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.315585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fbc24-2400-46fe-ace6-4c92cbbbe176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.338286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-de1fbc24-2400-46fe-ace6-4c92cbbbe176 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:12.340188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-de1fbc24-2400-46fe-ace6-4c92cbbbe176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:12.427402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 613/1221] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:08:12.450824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca7b96-2f02-4f73-af9f-04292b10dee5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.599926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca7b96-2f02-4f73-af9f-04292b10dee5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.653423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f9e5-a6f0-459c-ac08-bc1f2834624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.654146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f9e5-a6f0-459c-ac08-bc1f2834624f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.654526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f9e5-a6f0-459c-ac08-bc1f2834624f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.654832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f9e5-a6f0-459c-ac08-bc1f2834624f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.668516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8f9e5-a6f0-459c-ac08-bc1f2834624f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-94c8f9e5-a6f0-459c-ac08-bc1f2834624f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:08:12.673550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:12.674945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:12.675818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 609/1222] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:08:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:12.681507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fbc24-2400-46fe-ace6-4c92cbbbe176 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.810024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fbc24-2400-46fe-ace6-4c92cbbbe176 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.846917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:12.865531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.866275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.866671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.866976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.867910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:12.868211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.869650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.879495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 614/1223] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:08:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:12.889188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f9e5-a6f0-459c-ac08-bc1f2834624f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.958077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:13.053085 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f9e5-a6f0-459c-ac08-bc1f2834624f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:13.102048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:13.102704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:13.103080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:13.103381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:13.116293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:13.117800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:13.145125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:13.146932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:13.155487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:13.155487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:13.155487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:13.155487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:13.155487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 610/1224] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:13.156115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:13.302531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd32a-6024-40b6-82a7-a70f0119bba7 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:13.344570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:13.345324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:13.345633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:13.345909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:13.346686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:13.347058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:13.348985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:13.368384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 615/1225] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:13.375992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:13.496714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:13.508032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e59ee-5edd-4aa8-8635-8ad1a68474ae None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:13.549657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:13.550321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:13.550599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:13.550871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:13.559340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:13.560786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:08:13.573603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:13.574864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:13.575913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 611/1226] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:13.581601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:13.636651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:13.705165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8afd5f-b3f4-4675-9085-7965d6bd051f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:13.755732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:13.756351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:13.756634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:13.756929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:13.757727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:13.758027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:13.759446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:13.779782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 616/1227] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Aug 4 21:08:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:13.786117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:13.935576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236316b5-bfe8-41c9-88b7-1b9e11d60fd1 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:13.977289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:13.978154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:13.978524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:13.978924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:13.993622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:13.995359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:14.013636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:14.015920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:14.017448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:14.017448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:14.017448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:14.017448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:14.017448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 612/1228] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:08:14.021941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:14.160471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08849b10-722a-45bd-861b-29c69be2dc4f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:14.167096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:14.207922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:14.208438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:14.208719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:14.209021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:14.209712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:14.210125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:14.211366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:14.224288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 617/1229] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:14.231374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:14.243297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:14.353273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf45a5-3fb4-4e30-94b6-fdb30cc44bd3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:14.410282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:14.411023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:14.411232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:14.411483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:14.419235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:14.420780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:08:14.433865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:14.435621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:14.437949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:08:14.437949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:08:14.437949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:08:14.437949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:08:14.437949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:08:14.437949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:08:14.437949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:14.437949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:14.440948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 613/1230] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:14.441917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:14.583919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3694-9348-4c0c-8547-b10e8bbad00b None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:14.652150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb677-ef5a-47ad-98b8-5440141cab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:14.653220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb677-ef5a-47ad-98b8-5440141cab9c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:14.653708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb677-ef5a-47ad-98b8-5440141cab9c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:14.654190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb677-ef5a-47ad-98b8-5440141cab9c None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:14.656539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eb677-ef5a-47ad-98b8-5440141cab9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:14.657123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eb677-ef5a-47ad-98b8-5440141cab9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:14.659769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eb677-ef5a-47ad-98b8-5440141cab9c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:14.682240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 618/1231] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:08:14.688780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:14.770623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:14.812798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c215dd-bc65-4a79-b6a4-b4bf2b91004e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:14.859441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b3352-626e-412a-8f18-2ccf05de46dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:14.859881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b3352-626e-412a-8f18-2ccf05de46dc None admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:14.860161 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b3352-626e-412a-8f18-2ccf05de46dc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:14.860433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b3352-626e-412a-8f18-2ccf05de46dc None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/afab8bad046e462b9bd6188fa01720d0/roles/7647001353b54c2789f738144d1189c7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:14.880762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b3352-626e-412a-8f18-2ccf05de46dc None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=afab8bad046e462b9bd6188fa01720d0, role_id=7647001353b54c2789f738144d1189c7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:14.882371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b3352-626e-412a-8f18-2ccf05de46dc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:14.986784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 614/1232] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:08:14 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/afab8bad046e462b9bd6188fa01720d0/roles/7647001353b54c2789f738144d1189c7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:08:17.355131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd9a3-5180-4f0f-94b2-4bb790cb58a7 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:17.355790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd9a3-5180-4f0f-94b2-4bb790cb58a7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:17.356019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd9a3-5180-4f0f-94b2-4bb790cb58a7 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:17.358296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 619/1233] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:17.365382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584ae97-f935-4bf2-9382-ac4e003fe2f1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:17.365981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584ae97-f935-4bf2-9382-ac4e003fe2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:17.365981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584ae97-f935-4bf2-9382-ac4e003fe2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:17.387468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f584ae97-f935-4bf2-9382-ac4e003fe2f1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:17.388704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f584ae97-f935-4bf2-9382-ac4e003fe2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:17.474785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 615/1234] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:08:17.502876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dd9a3-5180-4f0f-94b2-4bb790cb58a7 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:17.544002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:17.635138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dd9a3-5180-4f0f-94b2-4bb790cb58a7 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:17.686870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52741b8a-4fb4-480d-9e25-827bd09ac7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:17.687565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52741b8a-4fb4-480d-9e25-827bd09ac7ca None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:17.687891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52741b8a-4fb4-480d-9e25-827bd09ac7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:17.688221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52741b8a-4fb4-480d-9e25-827bd09ac7ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:17.703425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52741b8a-4fb4-480d-9e25-827bd09ac7ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-52741b8a-4fb4-480d-9e25-827bd09ac7ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:08:17.708860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:17.715346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:17.716871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 620/1235] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Aug 4 21:08:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:17.719196 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584ae97-f935-4bf2-9382-ac4e003fe2f1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:17.783736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:17.849849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584ae97-f935-4bf2-9382-ac4e003fe2f1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:17.904545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:17.907588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:17.907588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:17.907588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:17.908054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:17.908342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:17.911037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:17.927695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 616/1236] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Aug 4 21:08:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:17.936412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52741b8a-4fb4-480d-9e25-827bd09ac7ca None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:18.065280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:18.083193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52741b8a-4fb4-480d-9e25-827bd09ac7ca None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:18.138755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:18.140026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:18.140356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:18.140734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:18.153788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:18.156035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:18.174546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:18.180833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:18.182948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:18.182948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:18.182948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:18.182948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:18.182948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 621/1237] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:18.183568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:18.306123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed01a8-afaf-4d01-824f-ee5b085f9f02 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:18.317113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:18.345918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:18.346549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:18.346824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:18.347099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:18.347807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:18.348097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:18.349504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:18.362745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 617/1238] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:18.371747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:18.506030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ad342-8900-4e4f-8efc-cfeb33931899 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:18.558209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:18.559283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:18.559740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:18.560192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:18.564711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:18.572183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:18.574143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:08:18.588287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:18.590170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:18.591416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 622/1239] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:18.596701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:18.719894 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cfd15-c813-47bd-99a8-030518b300f6 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:18.761769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:18.762288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:18.762591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:18.762859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:18.763639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:18.763943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:18.765752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:18.784724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 618/1240] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Aug 4 21:08:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:18.799779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:18.925509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6f636-95c7-4347-8810-179daffe0b9f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:18.964656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac67fc-486f-455b-b0b2-e331f1b65ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:18.965457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac67fc-486f-455b-b0b2-e331f1b65ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:18.965731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac67fc-486f-455b-b0b2-e331f1b65ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:18.966038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac67fc-486f-455b-b0b2-e331f1b65ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:19.045204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:19.053379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac67fc-486f-455b-b0b2-e331f1b65ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:19.062891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac67fc-486f-455b-b0b2-e331f1b65ab4 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:19.172662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 623/1241] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:08:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 21:08:19.179372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:19.209029 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:19.305021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bab4b3-41a8-4250-a653-28ab8d834473 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:19.341591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:19.342230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:19.342533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:19.343539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:19.354265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:19.356465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:19.371038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:19.372239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:19.373187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:19.373187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:19.373187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:19.373187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:19.373187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 619/1242] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:19.378359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac67fc-486f-455b-b0b2-e331f1b65ab4 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:19.497306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:19.505900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac67fc-486f-455b-b0b2-e331f1b65ab4 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:19.541866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:19.542473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:19.542745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:19.543010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:19.543843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:19.544114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:19.545855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:19.557589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 624/1243] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:19.564489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:19.647874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:19.680142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c4b9-e81e-43c3-9c55-5fc56c7fcb5f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:19.724389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:19.725088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:19.725374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:19.725774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:19.737672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:19.739925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:08:19.754143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:19.755282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:19.756193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 620/1244] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:19.762776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:19.888225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14b65-2a5b-4ef3-b4a1-298c8907312c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:19.929835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2f687-2156-4113-8ca3-8e7a77e93460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:19.930473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f687-2156-4113-8ca3-8e7a77e93460 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:19.930746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f687-2156-4113-8ca3-8e7a77e93460 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:19.931014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f687-2156-4113-8ca3-8e7a77e93460 None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:19.931789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f687-2156-4113-8ca3-8e7a77e93460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:19.932242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f687-2156-4113-8ca3-8e7a77e93460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:19.933876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f687-2156-4113-8ca3-8e7a77e93460 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:19.948803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 625/1245] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:19.955815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:20.075812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eb31d-0745-4d05-991b-3ca2ee0e28b9 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:20.124653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9219-ed3f-4e47-a7f8-d8868bc051c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:20.126684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9219-ed3f-4e47-a7f8-d8868bc051c1 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:20.126934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9219-ed3f-4e47-a7f8-d8868bc051c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:20.127494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9219-ed3f-4e47-a7f8-d8868bc051c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:20.128248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee9219-ed3f-4e47-a7f8-d8868bc051c1 None admin] RBAC: Adding query filter params (role.id=7647001353b54c2789f738144d1189c7, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=afab8bad046e462b9bd6188fa01720d0) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:20.129240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee9219-ed3f-4e47-a7f8-d8868bc051c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:20.130480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee9219-ed3f-4e47-a7f8-d8868bc051c1 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:20.137132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 621/1246] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:08:19 2022] GET /identity/v3/role_assignments?user.id=afab8bad046e462b9bd6188fa01720d0&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=7647001353b54c2789f738144d1189c7 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:22.399225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1e45-9551-4e69-962d-5fb28658c5e7 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:22.399905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1e45-9551-4e69-962d-5fb28658c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:22.400186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1e45-9551-4e69-962d-5fb28658c5e7 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:22.402692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 626/1247] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:22.411426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99859781-8b8b-45af-8ba3-6dab14bc6962 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:22.414639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99859781-8b8b-45af-8ba3-6dab14bc6962 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:22.414639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99859781-8b8b-45af-8ba3-6dab14bc6962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:22.419010 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:22.434399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-99859781-8b8b-45af-8ba3-6dab14bc6962 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:22.435981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-99859781-8b8b-45af-8ba3-6dab14bc6962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:22.521745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 622/1248] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:08:22.548289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae1e45-9551-4e69-962d-5fb28658c5e7 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:22.571557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:22.670009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae1e45-9551-4e69-962d-5fb28658c5e7 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:22.713034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fa4fd-2146-422e-9708-8d05880e3d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:22.713682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fa4fd-2146-422e-9708-8d05880e3d74 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:22.713960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fa4fd-2146-422e-9708-8d05880e3d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:22.714238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fa4fd-2146-422e-9708-8d05880e3d74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:22.726200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fa4fd-2146-422e-9708-8d05880e3d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-ef5fa4fd-2146-422e-9708-8d05880e3d74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:08:22.731408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:22.733548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:22.734633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 627/1249] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:08:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:22.740187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99859781-8b8b-45af-8ba3-6dab14bc6962 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:22.866772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99859781-8b8b-45af-8ba3-6dab14bc6962 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:22.902537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:22.912705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:22.913698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:22.914026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:22.914337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:22.915265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:22.915652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:22.917239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:22.927505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 623/1250] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:08:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:22.935091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fa4fd-2146-422e-9708-8d05880e3d74 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:23.049543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:23.088135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fa4fd-2146-422e-9708-8d05880e3d74 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:23.135134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:23.135804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:23.136082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:23.136347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:23.148722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:23.151840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:23.169595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:23.170908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:23.172002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:23.172002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:23.172002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:23.172002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:23.172002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 628/1251] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:23.176995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:23.302095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22173c9a-2a95-4513-998a-c00706ad84a8 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:23.339076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:23.340051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:23.340499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:23.340971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:23.342144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:23.343105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:23.345359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:23.361934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 624/1252] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:23.367904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:23.510459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d71cfc-ddf8-42d5-a7ba-0a15237de0de None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:23.549142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:23.557959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:23.558614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:23.558888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:23.559207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:23.568074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:23.573704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:08:23.585985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:23.588152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:23.595140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 629/1253] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:23.595911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:23.662230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:23.738854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29f51-d9bd-4bb7-8524-6d60957f1670 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:23.800211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:23.800806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:23.801117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:23.801400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:23.802194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:23.802500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:23.803946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:23.834088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 625/1254] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Aug 4 21:08:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:23.845775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:23.965086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9dc9-e0f0-4c22-9bc3-cb972815f920 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:24.005288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a6a4-1721-40df-8098-b407959b06ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:24.005914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a6a4-1721-40df-8098-b407959b06ff None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:24.006192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a6a4-1721-40df-8098-b407959b06ff None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:24.006512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a6a4-1721-40df-8098-b407959b06ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:24.064720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:24.085566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8a6a4-1721-40df-8098-b407959b06ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:24.086952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8a6a4-1721-40df-8098-b407959b06ff None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:24.197902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 630/1255] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:08:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 21:08:24.204563 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:24.351327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5128d1-4f8d-4d57-8076-d4591b7e64a5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:24.367980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:24.393626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:24.394284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:24.394570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:24.394843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:24.406254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:24.414615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:24.427571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:24.428733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:24.429991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:24.429991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:24.429991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:24.429991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:24.429991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 626/1256] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:24.434664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a6a4-1721-40df-8098-b407959b06ff None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:24.542028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:24.557776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a6a4-1721-40df-8098-b407959b06ff None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:24.595176 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:24.595795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:24.596106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:24.596345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:24.597059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:24.597365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:24.598724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:24.619393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 631/1257] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:24.619644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:24.730317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67082f34-c647-47b6-afbe-acadea768619 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:24.770872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:24.771524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:24.771806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:24.772081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:24.782762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:24.784271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:08:24.796932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:24.798105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:24.799225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 627/1258] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 21:08:24.804597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:24.913962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bd9c3-a03c-441e-a7c5-8dec1de1d6d5 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:24.952960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb730d-5442-4431-aad1-2ac80cdba24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:24.953661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb730d-5442-4431-aad1-2ac80cdba24b None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:24.953944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb730d-5442-4431-aad1-2ac80cdba24b None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:24.954219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb730d-5442-4431-aad1-2ac80cdba24b None admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:24.954971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb730d-5442-4431-aad1-2ac80cdba24b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:24.955275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb730d-5442-4431-aad1-2ac80cdba24b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:24.956742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb730d-5442-4431-aad1-2ac80cdba24b None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:24.970945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 632/1259] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:08:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:24.977504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:25.005880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:25.084031 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04081563-ae79-4754-9123-32a53172eba5 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:25.120115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1c660-1ac8-4ca9-ae5c-9b8b13d80ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:25.120728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1c660-1ac8-4ca9-ae5c-9b8b13d80ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:25.121042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1c660-1ac8-4ca9-ae5c-9b8b13d80ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:25.121316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1c660-1ac8-4ca9-ae5c-9b8b13d80ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:25.122094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1c660-1ac8-4ca9-ae5c-9b8b13d80ef0 None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=afab8bad046e462b9bd6188fa01720d0) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:25.122397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1c660-1ac8-4ca9-ae5c-9b8b13d80ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:25.123869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1c660-1ac8-4ca9-ae5c-9b8b13d80ef0 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:25.129878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 628/1260] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:08:24 2022] GET /identity/v3/role_assignments?user.id=afab8bad046e462b9bd6188fa01720d0&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:27.199264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a37f-5d99-4f6e-a1b9-3acdc532a2e4 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:27.199803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a37f-5d99-4f6e-a1b9-3acdc532a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:27.199803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a37f-5d99-4f6e-a1b9-3acdc532a2e4 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:27.201269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 633/1261] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:08:27.208964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9382b-be3d-4774-a704-6e87d1ac0764 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:27.209453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9382b-be3d-4774-a704-6e87d1ac0764 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:27.209551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9382b-be3d-4774-a704-6e87d1ac0764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:27.231088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-0ca9382b-be3d-4774-a704-6e87d1ac0764 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:27.232294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0ca9382b-be3d-4774-a704-6e87d1ac0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:27.310513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 629/1262] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 21:08:27.333884 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881a37f-5d99-4f6e-a1b9-3acdc532a2e4 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:27.345191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:27.449255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881a37f-5d99-4f6e-a1b9-3acdc532a2e4 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:27.487134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4481a1f-6a70-4512-b7e0-14d25b6e203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:27.487686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481a1f-6a70-4512-b7e0-14d25b6e203f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:27.487961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481a1f-6a70-4512-b7e0-14d25b6e203f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:27.488226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4481a1f-6a70-4512-b7e0-14d25b6e203f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:27.500064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4481a1f-6a70-4512-b7e0-14d25b6e203f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-c4481a1f-6a70-4512-b7e0-14d25b6e203f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:08:27.505643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:27.506800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:27.507783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 634/1263] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:08:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:27.513343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9382b-be3d-4774-a704-6e87d1ac0764 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:27.534298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:27.641393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9382b-be3d-4774-a704-6e87d1ac0764 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:27.679202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:27.679829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:27.680110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:27.680382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:27.681243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:27.681590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:27.682951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:27.693186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 630/1264] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:08:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:27.699822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4481a1f-6a70-4512-b7e0-14d25b6e203f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:27.787370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:27.830114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4481a1f-6a70-4512-b7e0-14d25b6e203f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:27.865080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:27.865717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:27.866563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:27.866834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:27.878761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:27.880220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:27.903054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:27.904091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:27.905653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:27.905653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:27.905653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:27.905653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:27.905653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 635/1265] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:27.911469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:28.016467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:28.037550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4091a6-de62-42a0-a5b9-4d98c9905383 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:28.080507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:28.081158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:28.081499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:28.081712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:28.082399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:28.082703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:28.084072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:28.098635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 631/1266] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:28.105507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:28.240610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22a96-5c89-4efd-9d87-de9757ccfef6 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:28.268898 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:28.287133 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:28.287832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:28.288063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:28.288557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:28.297412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:28.299004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:08:28.311281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:28.313901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:28.315641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 636/1267] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:28.319775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:28.447370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89657573-a245-450a-92f0-037edf9bf877 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:28.495144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:28.495775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:28.496050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:28.496319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:28.497211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:28.497519 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:28.499817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:28.511337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:28.521782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 632/1268] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Aug 4 21:08:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:28.528024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:28.650991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b66207-712f-40c3-971c-2c61f2d45d01 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:28.694389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:28.695265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:28.695576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:28.695853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:28.709814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:28.711299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:28.729018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:28.732852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:28.734754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:28.734754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:28.734754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:28.734754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:28.734754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 637/1269] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:28.737431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:28.868712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05469d7-00e5-4988-8882-5acc79c607d3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:28.906511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:28.907055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:28.907333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:28.907602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:28.908294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:28.908599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:28.910007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:28.922589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 633/1270] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:28.933936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:28.967910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:29.052791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d688de3-3805-4039-be2a-e0e65427d57d None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:29.090950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:29.091593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:29.091879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:29.092150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:29.100586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:29.102083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:08:29.115823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:29.116972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:29.118206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 638/1271] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:08:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:29.123191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:29.197887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:29.244048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a97f6-ec29-4983-aba1-218be6aeba2d None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:29.286935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaeceb-a9d7-4e07-ad02-b5fd929e6703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:29.287558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaeceb-a9d7-4e07-ad02-b5fd929e6703 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:29.287833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaeceb-a9d7-4e07-ad02-b5fd929e6703 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:29.288101 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaeceb-a9d7-4e07-ad02-b5fd929e6703 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:29.289136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaeceb-a9d7-4e07-ad02-b5fd929e6703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:29.289440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaeceb-a9d7-4e07-ad02-b5fd929e6703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:29.290942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaeceb-a9d7-4e07-ad02-b5fd929e6703 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:29.308312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 634/1272] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:08:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:29.315158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:29.430454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:29.439917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec06e1d-a9b7-47f0-8e6d-4f6e231b2743 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:29.484294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd676e1-ec39-4bc2-9743-0e469611af0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:29.484294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd676e1-ec39-4bc2-9743-0e469611af0a None admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:29.484294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd676e1-ec39-4bc2-9743-0e469611af0a None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:29.484294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd676e1-ec39-4bc2-9743-0e469611af0a None admin] PATH_INFO: `/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/afab8bad046e462b9bd6188fa01720d0/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:29.485654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd676e1-ec39-4bc2-9743-0e469611af0a None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2ffb95af54340bb23ab0e10a7351b, user_id=afab8bad046e462b9bd6188fa01720d0, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:29.487145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd676e1-ec39-4bc2-9743-0e469611af0a None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:29.644213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 639/1273] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Aug 4 21:08:29 2022] PUT /identity/v3/projects/f2b2ffb95af54340bb23ab0e10a7351b/users/afab8bad046e462b9bd6188fa01720d0/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:08:31.796478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b11c-2831-4cec-9a6c-5322581c6066 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:31.797484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b11c-2831-4cec-9a6c-5322581c6066 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:31.797484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b11c-2831-4cec-9a6c-5322581c6066 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:31.798831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 635/1274] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:31.804777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e541eb-c1fc-4cdb-a9c2-eda790a153f4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:31.805496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e541eb-c1fc-4cdb-a9c2-eda790a153f4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:31.805496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e541eb-c1fc-4cdb-a9c2-eda790a153f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:31.824558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a0e541eb-c1fc-4cdb-a9c2-eda790a153f4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:31.825861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a0e541eb-c1fc-4cdb-a9c2-eda790a153f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:31.906077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 640/1275] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:08:31.930462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185b11c-2831-4cec-9a6c-5322581c6066 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:32.054240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185b11c-2831-4cec-9a6c-5322581c6066 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:32.074969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:32.095119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f125cd4-91c3-46ec-8136-513cb1361f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:32.096036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f125cd4-91c3-46ec-8136-513cb1361f48 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:32.096507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f125cd4-91c3-46ec-8136-513cb1361f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:32.097050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f125cd4-91c3-46ec-8136-513cb1361f48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:32.111247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f125cd4-91c3-46ec-8136-513cb1361f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-5f125cd4-91c3-46ec-8136-513cb1361f48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 21:08:32.116318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:32.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:32.119083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 636/1276] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Aug 4 21:08:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:32.124862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e541eb-c1fc-4cdb-a9c2-eda790a153f4 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:32.230876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:32.263500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e541eb-c1fc-4cdb-a9c2-eda790a153f4 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:32.320820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:32.321549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:32.321871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:32.322184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:32.322950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:32.323292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:32.324766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:32.342273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 641/1277] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Aug 4 21:08:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:32.351090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f125cd4-91c3-46ec-8136-513cb1361f48 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:32.508274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f125cd4-91c3-46ec-8136-513cb1361f48 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:32.567698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:32.570277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:32.570640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:32.571078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:32.587276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:32.589951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:32.609034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:32.610104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:32.611716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:32.611716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:32.611716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:32.611716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:32.611716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 637/1278] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:32.619779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:32.780941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1620cb-16ad-4ef4-b060-3193e586db7f None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:32.835969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:32.836982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:32.837162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:32.837582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:32.838530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:32.839010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:32.841064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:32.863617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 642/1279] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:32.870066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:32.907325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:32.999664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ce83-26a0-407f-9bbf-05569ef243cc None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:33.040545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:33.041227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:33.041506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:33.041775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:33.051763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:33.053509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 21:08:33.067886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:33.069345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:33.070828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 638/1280] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:33.079500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:33.085534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:33.199702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42df2-0bfd-46dc-b24d-0228ea471625 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:33.250671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:33.251289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:33.251564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:33.251833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:33.252615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:33.252937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:33.254354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:33.275770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 643/1281] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Aug 4 21:08:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:33.284827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:33.404767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:33.418070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf06f6-82bb-40fe-b414-04f65723a27e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:33.465958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518635b4-8bba-4559-b37c-7962bd5c066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:33.466452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518635b4-8bba-4559-b37c-7962bd5c066f None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:33.466732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518635b4-8bba-4559-b37c-7962bd5c066f None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:33.467007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518635b4-8bba-4559-b37c-7962bd5c066f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:33.547193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518635b4-8bba-4559-b37c-7962bd5c066f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:33.548839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518635b4-8bba-4559-b37c-7962bd5c066f None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:33.651077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:33.664457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 639/1282] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Aug 4 21:08:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 21:08:33.671377 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:33.742445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:33.789648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39e7f-c109-4933-97e5-89cca3463319 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:33.832964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:33.833612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:33.833891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:33.834163 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:33.845507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:33.847021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 21:08:33.862768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:33.864016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:33.865114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 21:08:33.865114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 21:08:33.865114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 21:08:33.865114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:33.865114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 644/1283] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:33.870711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518635b4-8bba-4559-b37c-7962bd5c066f None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:33.996753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518635b4-8bba-4559-b37c-7962bd5c066f None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:34.034830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:34.035237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:34.035503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:34.035770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:34.036458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:34.036754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:34.038175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:34.050859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 640/1284] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Aug 4 21:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:34.056693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:34.192394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd08f6-af4e-4100-a10d-8d3da75ee984 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:34.211851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:34.234734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:34.234734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:34.234734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:34.235449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:34.242758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:34.244215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 21:08:34.258808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:34.259916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: ERROR keystone.server.flask.application Aug 04 21:08:34.261091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 645/1285] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Aug 4 21:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:34.267758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:34.353026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:34.418116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d7ae-69ea-453b-a89b-8a992ec425b3 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:34.461780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbcc29-ee2b-48db-bbb1-0bc4868060e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:34.462393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbcc29-ee2b-48db-bbb1-0bc4868060e8 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:34.462690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbcc29-ee2b-48db-bbb1-0bc4868060e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:34.462951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbcc29-ee2b-48db-bbb1-0bc4868060e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:34.463706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbcc29-ee2b-48db-bbb1-0bc4868060e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:34.464006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbcc29-ee2b-48db-bbb1-0bc4868060e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:34.465501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbcc29-ee2b-48db-bbb1-0bc4868060e8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:34.486296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 641/1286] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Aug 4 21:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:34.492820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:34.613528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cfb56-143c-4a5f-b2fd-0bf5b25c8741 None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:34.650698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99aff-ed5b-45b8-b4d7-4fb07fe173ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:34.650698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99aff-ed5b-45b8-b4d7-4fb07fe173ff None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:34.651036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99aff-ed5b-45b8-b4d7-4fb07fe173ff None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:34.651261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99aff-ed5b-45b8-b4d7-4fb07fe173ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:34.652182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a99aff-ed5b-45b8-b4d7-4fb07fe173ff None admin] RBAC: Adding query filter params (role.id=1ace4f50ff3d45f39658ba8804c18f16, scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b, user.id=afab8bad046e462b9bd6188fa01720d0) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:34.652492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a99aff-ed5b-45b8-b4d7-4fb07fe173ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:34.654050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a99aff-ed5b-45b8-b4d7-4fb07fe173ff None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:34.660834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 646/1287] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Aug 4 21:08:34 2022] GET /identity/v3/role_assignments?user.id=afab8bad046e462b9bd6188fa01720d0&scope.project.id=f2b2ffb95af54340bb23ab0e10a7351b&role.id=1ace4f50ff3d45f39658ba8804c18f16 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:36.850247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72279263-fd9e-450a-8364-c4331a479ae5 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:36.850836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72279263-fd9e-450a-8364-c4331a479ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:36.850836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72279263-fd9e-450a-8364-c4331a479ae5 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:36.852231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 642/1288] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:36.858002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40a80c-4d04-45e5-8e76-41e227658292 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:36.858472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40a80c-4d04-45e5-8e76-41e227658292 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:36.858564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40a80c-4d04-45e5-8e76-41e227658292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:36.878538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0d40a80c-4d04-45e5-8e76-41e227658292 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:36.879755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0d40a80c-4d04-45e5-8e76-41e227658292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:36.915779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:36.960725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 647/1289] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:08:36.986517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72279263-fd9e-450a-8364-c4331a479ae5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:37.106596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72279263-fd9e-450a-8364-c4331a479ae5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:37.118128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:37.143637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:37.144287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:37.144559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:37.144840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:37.145592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:37.146979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:37.158110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:37.159614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:37.160612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 643/1290] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:08:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:37.166073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40a80c-4d04-45e5-8e76-41e227658292 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:37.280661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40a80c-4d04-45e5-8e76-41e227658292 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:37.319834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a42eab-bc1d-4ed0-b4dd-4fb4a9c4ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:37.320463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a42eab-bc1d-4ed0-b4dd-4fb4a9c4ddea None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:37.320740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a42eab-bc1d-4ed0-b4dd-4fb4a9c4ddea None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:37.321052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a42eab-bc1d-4ed0-b4dd-4fb4a9c4ddea None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:37.321727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a42eab-bc1d-4ed0-b4dd-4fb4a9c4ddea None admin] RBAC: Adding query filter params (name=placement) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:37.322034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a42eab-bc1d-4ed0-b4dd-4fb4a9c4ddea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:37.323402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a42eab-bc1d-4ed0-b4dd-4fb4a9c4ddea None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:37.332681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 648/1291] 10.222.0.93 () {56 vars in 1116 bytes} [Thu Aug 4 21:08:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:37.339368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:37.451524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4299d8d-4f1a-405a-bbec-8b1c3cd3398e None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:37.487995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e72a75-636e-4fd7-9325-d7a8b269324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:37.488613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72a75-636e-4fd7-9325-d7a8b269324e None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:37.488907 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72a75-636e-4fd7-9325-d7a8b269324e None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:37.489194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72a75-636e-4fd7-9325-d7a8b269324e None admin] PATH_INFO: `/v3/services` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:37.489867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e72a75-636e-4fd7-9325-d7a8b269324e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:37.490169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e72a75-636e-4fd7-9325-d7a8b269324e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:37.491715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e72a75-636e-4fd7-9325-d7a8b269324e None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:37.496787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 644/1292] 10.222.0.93 () {56 vars in 1116 bytes} [Thu Aug 4 21:08:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:39.624045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49afa0-5737-4c86-a3e5-45724dfab348 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:39.624617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49afa0-5737-4c86-a3e5-45724dfab348 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:39.624617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49afa0-5737-4c86-a3e5-45724dfab348 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:39.626185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 649/1293] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:39.632641 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce396a8-74b8-4d19-9720-7b3c85372335 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:39.633311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce396a8-74b8-4d19-9720-7b3c85372335 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:39.633311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce396a8-74b8-4d19-9720-7b3c85372335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:39.653514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-0ce396a8-74b8-4d19-9720-7b3c85372335 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:39.655623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0ce396a8-74b8-4d19-9720-7b3c85372335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:39.702394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:39.753925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 645/1294] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:08:39.783459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49afa0-5737-4c86-a3e5-45724dfab348 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:39.834323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:39.943647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49afa0-5737-4c86-a3e5-45724dfab348 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:40.000650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f763ce-5c3e-4dc3-bad0-97f93e1fd4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:40.001654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f763ce-5c3e-4dc3-bad0-97f93e1fd4d7 None admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:40.002100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f763ce-5c3e-4dc3-bad0-97f93e1fd4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:40.002566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f763ce-5c3e-4dc3-bad0-97f93e1fd4d7 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:40.003775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f763ce-5c3e-4dc3-bad0-97f93e1fd4d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:40.006216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f763ce-5c3e-4dc3-bad0-97f93e1fd4d7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:40.105563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 650/1295] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Aug 4 21:08:39 2022] POST /identity/v3/services => generated 246 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:08:42.243680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1d55-64c2-4e35-8607-eb48d694567c None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:42.244244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1d55-64c2-4e35-8607-eb48d694567c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:42.244244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1d55-64c2-4e35-8607-eb48d694567c None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:42.245624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 646/1296] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:42.251816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3489e-315d-4779-906e-b56131d5f328 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:42.252373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3489e-315d-4779-906e-b56131d5f328 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:42.252373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3489e-315d-4779-906e-b56131d5f328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:42.276782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0fc3489e-315d-4779-906e-b56131d5f328 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:42.278114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0fc3489e-315d-4779-906e-b56131d5f328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:42.363672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 651/1297] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:08:42.387670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb1d55-64c2-4e35-8607-eb48d694567c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:42.516964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb1d55-64c2-4e35-8607-eb48d694567c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:42.566796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:42.567510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:42.567786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:42.568056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:42.569846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:42.571399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:42.582858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:42.584138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:42.585028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 647/1298] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:08:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:42.591017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3489e-315d-4779-906e-b56131d5f328 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:42.617436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:42.703092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3489e-315d-4779-906e-b56131d5f328 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:42.745903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:42.746599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:42.746833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:42.747293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:42.747875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:42.748606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:42.750471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:42.756410 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 652/1299] 10.222.0.93 () {56 vars in 1116 bytes} [Thu Aug 4 21:08:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:08:42.762944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:42.803652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:42.878818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c93c2-26d0-4902-9615-97a0a52bc341 None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:42.917344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef026029-6fe4-4b0f-8912-c09a070e82ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:42.917963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef026029-6fe4-4b0f-8912-c09a070e82ae None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:42.918341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef026029-6fe4-4b0f-8912-c09a070e82ae None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:42.918610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef026029-6fe4-4b0f-8912-c09a070e82ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:42.919372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef026029-6fe4-4b0f-8912-c09a070e82ae None admin] RBAC: Adding query filter params (interface=public, service_id=131ef9d9196f410182a0a922bc6b7103, region_id=RegionOne) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:42.919680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef026029-6fe4-4b0f-8912-c09a070e82ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:42.921658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef026029-6fe4-4b0f-8912-c09a070e82ae None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:42.928425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 648/1300] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Aug 4 21:08:42 2022] GET /identity/v3/endpoints?service_id=131ef9d9196f410182a0a922bc6b7103&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:42.935194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:43.027638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:43.051721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99cc5a-db36-4e6b-97b5-ed0e910e0b1c None admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:43.089378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dc913-9e66-4aed-b76e-fd97b144abcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:43.089983 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dc913-9e66-4aed-b76e-fd97b144abcd None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:43.090403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dc913-9e66-4aed-b76e-fd97b144abcd None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:43.090670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dc913-9e66-4aed-b76e-fd97b144abcd None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:43.091307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dc913-9e66-4aed-b76e-fd97b144abcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:43.093621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dc913-9e66-4aed-b76e-fd97b144abcd None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:43.100587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 653/1301] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Aug 4 21:08:42 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:08:45.181251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0ec6e-b173-47c2-9e7c-deb7e104988d None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:45.181799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0ec6e-b173-47c2-9e7c-deb7e104988d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:45.181799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0ec6e-b173-47c2-9e7c-deb7e104988d None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:45.183103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 649/1302] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:08:45.189248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833e03-a052-4cb7-ac04-3a11495fcfe5 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:45.189765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833e03-a052-4cb7-ac04-3a11495fcfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:45.189858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833e03-a052-4cb7-ac04-3a11495fcfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:45.209211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-dc833e03-a052-4cb7-ac04-3a11495fcfe5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:45.210661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-dc833e03-a052-4cb7-ac04-3a11495fcfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:45.291674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 654/1303] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:08:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 21:08:45.316527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0ec6e-b173-47c2-9e7c-deb7e104988d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:45.439070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:45.450701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0ec6e-b173-47c2-9e7c-deb7e104988d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:45.507593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:45.508357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:45.508733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:45.509129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:45.509879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:45.511359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 21:08:45.523488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 21:08:45.525090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application with Lock( Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self._enter() Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application return self.creator() Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application created_value = creator( Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: ERROR keystone.server.flask.application Aug 04 21:08:45.526370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 650/1304] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Aug 4 21:08:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 21:08:45.533671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc833e03-a052-4cb7-ac04-3a11495fcfe5 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:45.630817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:45.656690 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc833e03-a052-4cb7-ac04-3a11495fcfe5 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:45.694260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7082f71-c0ea-45e7-b5fb-874a5f5b0fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:45.694798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7082f71-c0ea-45e7-b5fb-874a5f5b0fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:45.695079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7082f71-c0ea-45e7-b5fb-874a5f5b0fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:45.695350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7082f71-c0ea-45e7-b5fb-874a5f5b0fa7 None admin] PATH_INFO: `/v3/services` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:45.696031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7082f71-c0ea-45e7-b5fb-874a5f5b0fa7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:45.696336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7082f71-c0ea-45e7-b5fb-874a5f5b0fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:45.698038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7082f71-c0ea-45e7-b5fb-874a5f5b0fa7 None admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:45.704310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 655/1305] 10.222.0.93 () {56 vars in 1116 bytes} [Thu Aug 4 21:08:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:45.721608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:45.827364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fbde7-f1e4-4788-99e1-fe4800005f5b None admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:45.864548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ea144-1a20-4af0-9e49-57e1801500d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:45.865199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ea144-1a20-4af0-9e49-57e1801500d8 None admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:45.865484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ea144-1a20-4af0-9e49-57e1801500d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:45.865760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ea144-1a20-4af0-9e49-57e1801500d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:45.866476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ea144-1a20-4af0-9e49-57e1801500d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:45.868028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ea144-1a20-4af0-9e49-57e1801500d8 None admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:46.041425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 651/1306] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:08:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:08:55.790436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=30 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:56.035987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:15:58.433806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ee0f8-ce61-44b4-8fce-b8686af88b39 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:15:58.434911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ee0f8-ce61-44b4-8fce-b8686af88b39 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:15:58.435415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ee0f8-ce61-44b4-8fce-b8686af88b39 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:15:58.443021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 656/1307] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:15:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:15:58.444574 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad83ae5-0f68-42b4-9638-dc4e9567389e None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:15:58.445024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad83ae5-0f68-42b4-9638-dc4e9567389e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:15:58.445450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad83ae5-0f68-42b4-9638-dc4e9567389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:15:58.553852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-dad83ae5-0f68-42b4-9638-dc4e9567389e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:15:58.555647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-dad83ae5-0f68-42b4-9638-dc4e9567389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:15:58.701443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 652/1308] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:15:58.751187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e12b9-be46-4d83-8f4c-5ebfd7b11db7 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:15:58.751700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e12b9-be46-4d83-8f4c-5ebfd7b11db7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:15:58.752194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e12b9-be46-4d83-8f4c-5ebfd7b11db7 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:15:58.753978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 657/1309] 10.222.0.93 () {54 vars in 965 bytes} [Thu Aug 4 21:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:15:58.760212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966251fe-b5d4-4f77-804f-90719143f8f1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:15:58.760486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966251fe-b5d4-4f77-804f-90719143f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:15:58.760769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966251fe-b5d4-4f77-804f-90719143f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:15:58.910349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-966251fe-b5d4-4f77-804f-90719143f8f1 None None] MFA Rules not processed for user `a67b35a2567941f59dd746a3813b9d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:15:58.911810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-966251fe-b5d4-4f77-804f-90719143f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:15:58.937673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:15:59.015933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 653/1310] 10.222.0.93 () {58 vars in 1062 bytes} [Thu Aug 4 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:15:59.024986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e12b9-be46-4d83-8f4c-5ebfd7b11db7 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:15:59.027051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2a6e12b9-be46-4d83-8f4c-5ebfd7b11db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:15:59.161717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e12b9-be46-4d83-8f4c-5ebfd7b11db7 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:15:59.250648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95193-9e20-4a44-a173-2edbbfae061d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:15:59.251696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95193-9e20-4a44-a173-2edbbfae061d service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:15:59.252208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95193-9e20-4a44-a173-2edbbfae061d service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:15:59.252706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95193-9e20-4a44-a173-2edbbfae061d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:15:59.256324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-84d95193-9e20-4a44-a173-2edbbfae061d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:15:59.321467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:15:59.509274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95193-9e20-4a44-a173-2edbbfae061d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:15:59.510645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95193-9e20-4a44-a173-2edbbfae061d service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:15:59.533389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 658/1311] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:01.958421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364418-3995-473e-b53a-3700c83dd65a None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:01.958816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364418-3995-473e-b53a-3700c83dd65a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:01.958984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364418-3995-473e-b53a-3700c83dd65a None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:01.960341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 654/1312] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:01.965804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bbc10-e1af-4388-a071-c82f2afc9eff None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:01.966239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bbc10-e1af-4388-a071-c82f2afc9eff None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:01.966428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bbc10-e1af-4388-a071-c82f2afc9eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:02.053250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4c7bbc10-e1af-4388-a071-c82f2afc9eff None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:02.054535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4c7bbc10-e1af-4388-a071-c82f2afc9eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:02.157151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 659/1313] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:02.213439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b93920-003a-43be-af8a-00147db6f1dd None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:02.213586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b93920-003a-43be-af8a-00147db6f1dd None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:02.213861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b93920-003a-43be-af8a-00147db6f1dd None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:02.215316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 655/1314] 10.222.0.93 () {54 vars in 965 bytes} [Thu Aug 4 21:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:02.221396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf52e0-5748-48b9-a593-acd98a7993f4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:02.222378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf52e0-5748-48b9-a593-acd98a7993f4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:02.222554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf52e0-5748-48b9-a593-acd98a7993f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:02.234871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:02.301835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-54bf52e0-5748-48b9-a593-acd98a7993f4 None None] MFA Rules not processed for user `a67b35a2567941f59dd746a3813b9d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:02.303066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-54bf52e0-5748-48b9-a593-acd98a7993f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:02.379728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 660/1315] 10.222.0.93 () {58 vars in 1062 bytes} [Thu Aug 4 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:02.388739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b93920-003a-43be-af8a-00147db6f1dd None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:02.390289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-54b93920-003a-43be-af8a-00147db6f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:02.497316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b93920-003a-43be-af8a-00147db6f1dd None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:02.568661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:02.571307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32ccc9-43bf-43a0-bf05-78897fbfc9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:02.571928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ccc9-43bf-43a0-bf05-78897fbfc9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:02.572206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ccc9-43bf-43a0-bf05-78897fbfc9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:02.572478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ccc9-43bf-43a0-bf05-78897fbfc9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:02.574155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-de32ccc9-43bf-43a0-bf05-78897fbfc9d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:02.686736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32ccc9-43bf-43a0-bf05-78897fbfc9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:02.692730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32ccc9-43bf-43a0-bf05-78897fbfc9d6 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:02.706873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 656/1316] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:05.527881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa699951-dd58-4937-a3d4-cd47e90be4b8 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:05.528542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa699951-dd58-4937-a3d4-cd47e90be4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:05.528542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa699951-dd58-4937-a3d4-cd47e90be4b8 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:05.530215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 661/1317] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:05.535999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c789e5-05c0-4ddc-a01d-86cc7d4a5451 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:05.536451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c789e5-05c0-4ddc-a01d-86cc7d4a5451 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:05.536554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c789e5-05c0-4ddc-a01d-86cc7d4a5451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:05.605835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-82c789e5-05c0-4ddc-a01d-86cc7d4a5451 None None] MFA Rules not processed for user `48881791ec6346f88994e2d0e77b45c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:05.607080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-82c789e5-05c0-4ddc-a01d-86cc7d4a5451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:05.660729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:05.707494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 657/1318] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:05.751410 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa699951-dd58-4937-a3d4-cd47e90be4b8 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:05.763564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fa699951-dd58-4937-a3d4-cd47e90be4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:05.863300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa699951-dd58-4937-a3d4-cd47e90be4b8 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:05.866300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:05.938630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982e2e7-0bb3-4820-9324-1ce3da911916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:05.939241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982e2e7-0bb3-4820-9324-1ce3da911916 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:05.939520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982e2e7-0bb3-4820-9324-1ce3da911916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:05.939789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982e2e7-0bb3-4820-9324-1ce3da911916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:05.942326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b982e2e7-0bb3-4820-9324-1ce3da911916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:06.055299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982e2e7-0bb3-4820-9324-1ce3da911916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:06.056727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982e2e7-0bb3-4820-9324-1ce3da911916 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:06.076249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 662/1319] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:09.165197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4a190-85a8-43d6-9982-c5804b85b2fa None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:09.165764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4a190-85a8-43d6-9982-c5804b85b2fa None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:09.165764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4a190-85a8-43d6-9982-c5804b85b2fa None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:09.167132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 658/1320] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:09.172346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492235aa-ab2b-4b29-9a5e-3b575817b511 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:09.172802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492235aa-ab2b-4b29-9a5e-3b575817b511 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:09.172931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492235aa-ab2b-4b29-9a5e-3b575817b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:09.213102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:09.238012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-492235aa-ab2b-4b29-9a5e-3b575817b511 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:09.239229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-492235aa-ab2b-4b29-9a5e-3b575817b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:09.334873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 663/1321] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:09.374120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4a190-85a8-43d6-9982-c5804b85b2fa None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:09.375678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-00e4a190-85a8-43d6-9982-c5804b85b2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:09.481181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4a190-85a8-43d6-9982-c5804b85b2fa None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:09.556478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad90e00-1bf7-4aef-a753-f71484432254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:09.558466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90e00-1bf7-4aef-a753-f71484432254 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:09.558466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90e00-1bf7-4aef-a753-f71484432254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:09.558466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90e00-1bf7-4aef-a753-f71484432254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:09.559304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5ad90e00-1bf7-4aef-a753-f71484432254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:09.567000 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:09.668939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad90e00-1bf7-4aef-a753-f71484432254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:09.670381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad90e00-1bf7-4aef-a753-f71484432254 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:09.689198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 659/1322] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:13.087283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7f1e-c9f5-4ddc-ada3-c5f6be20d246 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:13.087879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7f1e-c9f5-4ddc-ada3-c5f6be20d246 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:13.087879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7f1e-c9f5-4ddc-ada3-c5f6be20d246 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:13.089312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 664/1323] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:16:13.094822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fdadc-b664-4c99-8153-6e36b23a3bc4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:13.095269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fdadc-b664-4c99-8153-6e36b23a3bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:13.095366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fdadc-b664-4c99-8153-6e36b23a3bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:13.165643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-cb0fdadc-b664-4c99-8153-6e36b23a3bc4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:13.166872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cb0fdadc-b664-4c99-8153-6e36b23a3bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:13.226756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:13.266450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 660/1324] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:13.304998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7f1e-c9f5-4ddc-ada3-c5f6be20d246 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:13.306538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9e5d7f1e-c9f5-4ddc-ada3-c5f6be20d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:13.426529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7f1e-c9f5-4ddc-ada3-c5f6be20d246 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:13.441225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:13.509023 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f910501-5ffe-48e6-8e6a-10a4dfbdf7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:13.509647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f910501-5ffe-48e6-8e6a-10a4dfbdf7de service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:13.509921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f910501-5ffe-48e6-8e6a-10a4dfbdf7de service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:13.510187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f910501-5ffe-48e6-8e6a-10a4dfbdf7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:13.512101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2f910501-5ffe-48e6-8e6a-10a4dfbdf7de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:13.626797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f910501-5ffe-48e6-8e6a-10a4dfbdf7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:13.629131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f910501-5ffe-48e6-8e6a-10a4dfbdf7de service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:13.648766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 665/1325] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:16.016870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4089-3ab0-4389-a3f3-a01ab3e3d4e7 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:16.017443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4089-3ab0-4389-a3f3-a01ab3e3d4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:16.017443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4089-3ab0-4389-a3f3-a01ab3e3d4e7 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:16.019432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 661/1326] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:16.024681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7ddb7-cbfe-460e-bb16-5fcccb3f6150 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:16.025145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7ddb7-cbfe-460e-bb16-5fcccb3f6150 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:16.025408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7ddb7-cbfe-460e-bb16-5fcccb3f6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:16.075024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:16.092694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-70d7ddb7-cbfe-460e-bb16-5fcccb3f6150 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:16.093938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-70d7ddb7-cbfe-460e-bb16-5fcccb3f6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:16.193305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 666/1327] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:16.229799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a4089-3ab0-4389-a3f3-a01ab3e3d4e7 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:16.231323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-832a4089-3ab0-4389-a3f3-a01ab3e3d4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:16.344067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a4089-3ab0-4389-a3f3-a01ab3e3d4e7 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:16.418078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e92e4-ba7e-40bb-ad18-a09c0962e8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:16.418712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e92e4-ba7e-40bb-ad18-a09c0962e8eb service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:16.418976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e92e4-ba7e-40bb-ad18-a09c0962e8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:16.419246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e92e4-ba7e-40bb-ad18-a09c0962e8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:16.420944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a10e92e4-ba7e-40bb-ad18-a09c0962e8eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:16.439224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:16.544530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e92e4-ba7e-40bb-ad18-a09c0962e8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:16.546013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e92e4-ba7e-40bb-ad18-a09c0962e8eb service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:16.565013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 662/1328] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:18.682016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70d87-d151-42c4-a890-6ae174b3a7c0 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:18.682564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70d87-d151-42c4-a890-6ae174b3a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:18.682564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f70d87-d151-42c4-a890-6ae174b3a7c0 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:18.683985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 667/1329] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:18.689520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0395e-d1df-43a6-921f-c9226128c9ac None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:18.690006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0395e-d1df-43a6-921f-c9226128c9ac None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:18.690679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0395e-d1df-43a6-921f-c9226128c9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:18.761175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-dfc0395e-d1df-43a6-921f-c9226128c9ac None None] MFA Rules not processed for user `48881791ec6346f88994e2d0e77b45c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:18.762679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-dfc0395e-d1df-43a6-921f-c9226128c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:18.838791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:18.873485 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 663/1330] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:18.913096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f70d87-d151-42c4-a890-6ae174b3a7c0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:18.914679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-29f70d87-d151-42c4-a890-6ae174b3a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:19.028538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f70d87-d151-42c4-a890-6ae174b3a7c0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:19.050426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:19.104731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f3de-4931-44d7-9ce0-e25eb039edfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:19.105397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f3de-4931-44d7-9ce0-e25eb039edfd service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:19.105672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f3de-4931-44d7-9ce0-e25eb039edfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:19.105939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f3de-4931-44d7-9ce0-e25eb039edfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:19.107566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1842f3de-4931-44d7-9ce0-e25eb039edfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:19.245418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842f3de-4931-44d7-9ce0-e25eb039edfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:19.246872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842f3de-4931-44d7-9ce0-e25eb039edfd service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:19.267468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 668/1331] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:22.029818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2635c5-631e-42d4-aa74-eab79ad7b752 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:22.030455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2635c5-631e-42d4-aa74-eab79ad7b752 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:22.030455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2635c5-631e-42d4-aa74-eab79ad7b752 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:22.031790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 664/1332] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:22.037487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709918f3-2b90-4821-b295-192a2dbb4777 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:22.037958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709918f3-2b90-4821-b295-192a2dbb4777 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:22.038150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709918f3-2b90-4821-b295-192a2dbb4777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:22.109440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:22.113245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-709918f3-2b90-4821-b295-192a2dbb4777 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:22.114603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-709918f3-2b90-4821-b295-192a2dbb4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:22.217905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 669/1333] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:22.254594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2635c5-631e-42d4-aa74-eab79ad7b752 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:22.256167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ed2635c5-631e-42d4-aa74-eab79ad7b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:22.363061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2635c5-631e-42d4-aa74-eab79ad7b752 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:22.439438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a07de-1f4b-405a-b39f-28c155e03644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:22.440686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a07de-1f4b-405a-b39f-28c155e03644 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:22.441034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a07de-1f4b-405a-b39f-28c155e03644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:22.441391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a07de-1f4b-405a-b39f-28c155e03644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:22.443673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-714a07de-1f4b-405a-b39f-28c155e03644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:22.470529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:22.561910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a07de-1f4b-405a-b39f-28c155e03644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:22.576527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a07de-1f4b-405a-b39f-28c155e03644 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:22.581600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 665/1334] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:24.692584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30990da5-2cac-47fe-9e05-5631c7a16fba None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:24.693211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30990da5-2cac-47fe-9e05-5631c7a16fba None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:24.693211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30990da5-2cac-47fe-9e05-5631c7a16fba None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:24.694751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 670/1335] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:24.700082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f0a33-cd7d-4778-884e-0f2ea734b75c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:24.700533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f0a33-cd7d-4778-884e-0f2ea734b75c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:24.700649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f0a33-cd7d-4778-884e-0f2ea734b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:24.766535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-949f0a33-cd7d-4778-884e-0f2ea734b75c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:24.767708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-949f0a33-cd7d-4778-884e-0f2ea734b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:24.843155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:24.865304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 666/1336] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:24.906728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30990da5-2cac-47fe-9e05-5631c7a16fba None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:24.908305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-30990da5-2cac-47fe-9e05-5631c7a16fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:25.012600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30990da5-2cac-47fe-9e05-5631c7a16fba None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:25.041181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:25.087008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f232fe8-61ef-4e78-9cd0-9a22c3641aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:25.087615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f232fe8-61ef-4e78-9cd0-9a22c3641aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:25.087888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f232fe8-61ef-4e78-9cd0-9a22c3641aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:25.088157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f232fe8-61ef-4e78-9cd0-9a22c3641aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:25.089792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8f232fe8-61ef-4e78-9cd0-9a22c3641aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:25.197507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f232fe8-61ef-4e78-9cd0-9a22c3641aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:25.198933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f232fe8-61ef-4e78-9cd0-9a22c3641aa7 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:25.217993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 671/1337] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:27.943338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307153-3282-45f9-96a2-bc4b1226d209 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:27.943881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307153-3282-45f9-96a2-bc4b1226d209 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:27.943881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307153-3282-45f9-96a2-bc4b1226d209 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:27.945304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 667/1338] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:27.950407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405970-ca4b-4158-92c3-131860266d8d None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:27.950832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405970-ca4b-4158-92c3-131860266d8d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:27.950925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405970-ca4b-4158-92c3-131860266d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:28.016836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-21405970-ca4b-4158-92c3-131860266d8d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:28.018705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-21405970-ca4b-4158-92c3-131860266d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:28.027541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:28.118310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 672/1339] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:28.155924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1307153-3282-45f9-96a2-bc4b1226d209 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:28.157507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f1307153-3282-45f9-96a2-bc4b1226d209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:28.266621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1307153-3282-45f9-96a2-bc4b1226d209 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:28.342986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1516d0e-56a3-4366-b998-1b1719f1a7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:28.343608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1516d0e-56a3-4366-b998-1b1719f1a7af service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:28.343889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1516d0e-56a3-4366-b998-1b1719f1a7af service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:28.344164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1516d0e-56a3-4366-b998-1b1719f1a7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:28.345834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b1516d0e-56a3-4366-b998-1b1719f1a7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:28.383369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:28.459958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1516d0e-56a3-4366-b998-1b1719f1a7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:28.461436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1516d0e-56a3-4366-b998-1b1719f1a7af service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:28.480242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 668/1340] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:32.912696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea946-ae4c-4731-8fa3-35aafc613b57 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:32.913253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea946-ae4c-4731-8fa3-35aafc613b57 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:32.913387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea946-ae4c-4731-8fa3-35aafc613b57 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:32.914752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 673/1341] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:32.919846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0753182-fcc9-4035-a05f-1c6e37b464c4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:32.920260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0753182-fcc9-4035-a05f-1c6e37b464c4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:32.920464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0753182-fcc9-4035-a05f-1c6e37b464c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:32.994035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d0753182-fcc9-4035-a05f-1c6e37b464c4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:32.995283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d0753182-fcc9-4035-a05f-1c6e37b464c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:33.090116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:33.102773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 669/1342] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:33.143187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ea946-ae4c-4731-8fa3-35aafc613b57 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:33.145321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5e7ea946-ae4c-4731-8fa3-35aafc613b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:33.252621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ea946-ae4c-4731-8fa3-35aafc613b57 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:33.290950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:33.326857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562526b-e3e1-4855-b779-250c57f9c0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:33.327466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562526b-e3e1-4855-b779-250c57f9c0aa service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:33.327737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562526b-e3e1-4855-b779-250c57f9c0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:33.328000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562526b-e3e1-4855-b779-250c57f9c0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:33.329663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c562526b-e3e1-4855-b779-250c57f9c0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:33.442616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562526b-e3e1-4855-b779-250c57f9c0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:33.444055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562526b-e3e1-4855-b779-250c57f9c0aa service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:33.463415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 674/1343] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:16:36.598219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54e8c-f0f3-4125-bcfc-dd3c8df8a4dd None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:36.598845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54e8c-f0f3-4125-bcfc-dd3c8df8a4dd None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:36.598845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54e8c-f0f3-4125-bcfc-dd3c8df8a4dd None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:36.600377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 670/1344] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:36.605400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badedff-f8f0-478d-bb03-1fdfc2ed5540 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:36.605880 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badedff-f8f0-478d-bb03-1fdfc2ed5540 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:36.605978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badedff-f8f0-478d-bb03-1fdfc2ed5540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:36.674485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9badedff-f8f0-478d-bb03-1fdfc2ed5540 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:36.675909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9badedff-f8f0-478d-bb03-1fdfc2ed5540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:36.694193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:36.775112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 675/1345] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:36.813503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf54e8c-f0f3-4125-bcfc-dd3c8df8a4dd None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:36.815577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-faf54e8c-f0f3-4125-bcfc-dd3c8df8a4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:36.925379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf54e8c-f0f3-4125-bcfc-dd3c8df8a4dd None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:37.006919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc0403-10a0-459a-87e5-f6c3759ef123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:37.009708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0403-10a0-459a-87e5-f6c3759ef123 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:37.009708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0403-10a0-459a-87e5-f6c3759ef123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:37.009708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0403-10a0-459a-87e5-f6c3759ef123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:37.009708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-11bc0403-10a0-459a-87e5-f6c3759ef123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:37.062462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:37.134430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc0403-10a0-459a-87e5-f6c3759ef123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:37.135913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc0403-10a0-459a-87e5-f6c3759ef123 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:37.157871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 671/1346] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:16:42.083347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2603-cf3e-4e81-9111-c456e1e510b5 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:42.083915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2603-cf3e-4e81-9111-c456e1e510b5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:42.083915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2603-cf3e-4e81-9111-c456e1e510b5 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:42.085261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 676/1347] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:16:42.091110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b1eaa-666c-4d55-82ff-82600ccb98e2 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:42.091613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b1eaa-666c-4d55-82ff-82600ccb98e2 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:42.092044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b1eaa-666c-4d55-82ff-82600ccb98e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:42.169127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-149b1eaa-666c-4d55-82ff-82600ccb98e2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:42.170354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-149b1eaa-666c-4d55-82ff-82600ccb98e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:42.306270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:42.312924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 672/1348] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:16:42.349149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c2603-cf3e-4e81-9111-c456e1e510b5 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:42.350736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c51c2603-cf3e-4e81-9111-c456e1e510b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:42.479466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c2603-cf3e-4e81-9111-c456e1e510b5 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:42.537341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:42.567011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d02c32-7296-47bc-9357-a5a259dbbfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:42.567804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d02c32-7296-47bc-9357-a5a259dbbfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:42.568204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d02c32-7296-47bc-9357-a5a259dbbfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:42.568726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d02c32-7296-47bc-9357-a5a259dbbfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:42.572068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-28d02c32-7296-47bc-9357-a5a259dbbfe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:42.712384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d02c32-7296-47bc-9357-a5a259dbbfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:42.713922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d02c32-7296-47bc-9357-a5a259dbbfe6 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:42.732934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 677/1349] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:16:47.841560 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8823a3d-fc6a-4a81-9813-6f79038a8351 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:47.842393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8823a3d-fc6a-4a81-9813-6f79038a8351 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:47.842821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8823a3d-fc6a-4a81-9813-6f79038a8351 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:47.844437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 673/1350] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:16:47.850768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18bcf0-076b-4696-94da-5ff0a1f83a80 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:47.851814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18bcf0-076b-4696-94da-5ff0a1f83a80 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:47.852237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18bcf0-076b-4696-94da-5ff0a1f83a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:47.951372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9a18bcf0-076b-4696-94da-5ff0a1f83a80 None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:47.952799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9a18bcf0-076b-4696-94da-5ff0a1f83a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:47.974697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:48.082047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 678/1351] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:52.476359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca079c-9c8a-45d1-a8dd-dbc630d10093 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:52.477333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca079c-9c8a-45d1-a8dd-dbc630d10093 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:52.477839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca079c-9c8a-45d1-a8dd-dbc630d10093 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:52.479984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 674/1352] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:52.485290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f9d63-4df8-4fcc-b81b-9cda3737588b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:52.486764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f9d63-4df8-4fcc-b81b-9cda3737588b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:52.487349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f9d63-4df8-4fcc-b81b-9cda3737588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:52.581410 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e75f9d63-4df8-4fcc-b81b-9cda3737588b None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:52.582632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e75f9d63-4df8-4fcc-b81b-9cda3737588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:52.666668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:52.714678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 679/1353] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:54.130970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680d869-35a6-4138-aeed-aa689fd73bfe None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:54.131519 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680d869-35a6-4138-aeed-aa689fd73bfe None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:54.131519 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680d869-35a6-4138-aeed-aa689fd73bfe None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:54.132873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 675/1354] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:54.137846 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866c84e-d805-4b97-bff4-51aaedbb1cea None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:54.138340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866c84e-d805-4b97-bff4-51aaedbb1cea None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:54.138568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866c84e-d805-4b97-bff4-51aaedbb1cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:54.220696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f866c84e-d805-4b97-bff4-51aaedbb1cea None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:54.221939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f866c84e-d805-4b97-bff4-51aaedbb1cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:54.331276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 680/1355] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:57.793145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e055-40c0-4f2e-b3ef-2891daaaa4b0 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:57.794124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e055-40c0-4f2e-b3ef-2891daaaa4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:57.794760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e055-40c0-4f2e-b3ef-2891daaaa4b0 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:57.796367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 676/1356] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:57.803199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368ece-828a-46a1-95f5-289f950492b7 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:57.803922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368ece-828a-46a1-95f5-289f950492b7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:57.804429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54368ece-828a-46a1-95f5-289f950492b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:57.858574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:57.895309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-54368ece-828a-46a1-95f5-289f950492b7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:57.896556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-54368ece-828a-46a1-95f5-289f950492b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:58.013913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 681/1357] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:58.070085 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dd7c-847c-4c3c-b6b0-d3a760be8fd8 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:58.070664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dd7c-847c-4c3c-b6b0-d3a760be8fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:58.071148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130dd7c-847c-4c3c-b6b0-d3a760be8fd8 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:58.073807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 677/1358] 10.222.0.93 () {54 vars in 962 bytes} [Thu Aug 4 21:16:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:16:58.081546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812615c-8d34-48c1-8ad1-74469053ca25 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:58.081788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812615c-8d34-48c1-8ad1-74469053ca25 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:58.082061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812615c-8d34-48c1-8ad1-74469053ca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:58.182913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0812615c-8d34-48c1-8ad1-74469053ca25 None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:16:58.184217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0812615c-8d34-48c1-8ad1-74469053ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:58.249481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:58.331936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 682/1359] 10.222.0.93 () {58 vars in 1059 bytes} [Thu Aug 4 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:16:58.339753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130dd7c-847c-4c3c-b6b0-d3a760be8fd8 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:58.341276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5130dd7c-847c-4c3c-b6b0-d3a760be8fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:58.498534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130dd7c-847c-4c3c-b6b0-d3a760be8fd8 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:58.580606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:58.623576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3a9f1-6771-4d85-9db9-af6b862fb0a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:58.624115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a9f1-6771-4d85-9db9-af6b862fb0a1 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:58.624396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a9f1-6771-4d85-9db9-af6b862fb0a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:58.624669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a9f1-6771-4d85-9db9-af6b862fb0a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:58.627212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e8c3a9f1-6771-4d85-9db9-af6b862fb0a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:58.732104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3a9f1-6771-4d85-9db9-af6b862fb0a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:58.733746 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3a9f1-6771-4d85-9db9-af6b862fb0a1 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:58.753845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 678/1360] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:01.033017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0916e-4b7b-4d1a-b2c8-b6a615511f90 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:01.033452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0916e-4b7b-4d1a-b2c8-b6a615511f90 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:01.033663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0916e-4b7b-4d1a-b2c8-b6a615511f90 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:01.037374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 683/1361] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:01.040326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b46-02d1-4f07-b479-13a14aec5117 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:01.040713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b46-02d1-4f07-b479-13a14aec5117 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:01.041059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b46-02d1-4f07-b479-13a14aec5117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:01.114060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f15b1b46-02d1-4f07-b479-13a14aec5117 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:01.115208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f15b1b46-02d1-4f07-b479-13a14aec5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:01.156346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:01.220414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 679/1362] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:01.267367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0916e-4b7b-4d1a-b2c8-b6a615511f90 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:01.268952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-24a0916e-4b7b-4d1a-b2c8-b6a615511f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:01.466338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0916e-4b7b-4d1a-b2c8-b6a615511f90 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:01.477957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:01.633313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed978b-1437-4b84-81f6-c16e3cbbb3c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:01.634024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed978b-1437-4b84-81f6-c16e3cbbb3c8 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:01.634391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed978b-1437-4b84-81f6-c16e3cbbb3c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:01.634774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed978b-1437-4b84-81f6-c16e3cbbb3c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:01.636453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-74ed978b-1437-4b84-81f6-c16e3cbbb3c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:01.734569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed978b-1437-4b84-81f6-c16e3cbbb3c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:01.737179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed978b-1437-4b84-81f6-c16e3cbbb3c8 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:01.757474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 684/1363] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:04.379666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f50df-2965-426d-a0fe-64be00090347 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:04.380253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f50df-2965-426d-a0fe-64be00090347 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:04.380253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f50df-2965-426d-a0fe-64be00090347 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:04.381613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 680/1364] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:04.386891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dce4c-cca8-46dc-8e67-c0725fd7cc1c None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:04.387381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dce4c-cca8-46dc-8e67-c0725fd7cc1c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:04.387482 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dce4c-cca8-46dc-8e67-c0725fd7cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:04.404336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:04.464238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a11dce4c-cca8-46dc-8e67-c0725fd7cc1c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:04.471007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a11dce4c-cca8-46dc-8e67-c0725fd7cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:04.582613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 685/1365] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:04.630041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374ff5-be02-4d72-9a90-e2f86f0fc415 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:04.630324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374ff5-be02-4d72-9a90-e2f86f0fc415 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:04.630596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374ff5-be02-4d72-9a90-e2f86f0fc415 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:04.631945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 681/1366] 10.222.0.93 () {54 vars in 962 bytes} [Thu Aug 4 21:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:04.637389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfe3d-031b-48f2-aa16-838b229c89ed None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:04.637750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfe3d-031b-48f2-aa16-838b229c89ed None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:04.638090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfe3d-031b-48f2-aa16-838b229c89ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:04.727289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-29fbfe3d-031b-48f2-aa16-838b229c89ed None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:04.728620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-29fbfe3d-031b-48f2-aa16-838b229c89ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:04.770206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:04.867378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 686/1367] 10.222.0.93 () {58 vars in 1059 bytes} [Thu Aug 4 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:04.876292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca374ff5-be02-4d72-9a90-e2f86f0fc415 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:04.878357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ca374ff5-be02-4d72-9a90-e2f86f0fc415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:05.049054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca374ff5-be02-4d72-9a90-e2f86f0fc415 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:05.073226 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:05.178044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cf5e0-205c-4917-8ed3-b453ee95d4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:05.178652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cf5e0-205c-4917-8ed3-b453ee95d4d5 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:05.178929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cf5e0-205c-4917-8ed3-b453ee95d4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:05.179237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cf5e0-205c-4917-8ed3-b453ee95d4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:05.180843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-072cf5e0-205c-4917-8ed3-b453ee95d4d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:05.280026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cf5e0-205c-4917-8ed3-b453ee95d4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:05.281663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cf5e0-205c-4917-8ed3-b453ee95d4d5 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:05.303474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 682/1368] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:06.268325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d55a1-09bf-4d44-b0e0-510b043725d1 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:06.269047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d55a1-09bf-4d44-b0e0-510b043725d1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:06.269047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d55a1-09bf-4d44-b0e0-510b043725d1 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:06.270443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 687/1369] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:06.275600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58367-b471-4386-a2b9-779b31a1cf62 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:06.276063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58367-b471-4386-a2b9-779b31a1cf62 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:06.276157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58367-b471-4386-a2b9-779b31a1cf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:06.311684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:06.348539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-bdf58367-b471-4386-a2b9-779b31a1cf62 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:06.349842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bdf58367-b471-4386-a2b9-779b31a1cf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:06.456589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 683/1370] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:06.806580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8ec8-3684-4194-894e-8e6325395410 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:06.806865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8ec8-3684-4194-894e-8e6325395410 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:06.807137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8ec8-3684-4194-894e-8e6325395410 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:06.809325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 688/1371] 10.222.0.93 () {54 vars in 964 bytes} [Thu Aug 4 21:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:06.814336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3f9c-2b47-4930-8e63-bd73d9d58945 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:06.814691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3f9c-2b47-4930-8e63-bd73d9d58945 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:06.815016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3f9c-2b47-4930-8e63-bd73d9d58945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:06.900739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-36ff3f9c-2b47-4930-8e63-bd73d9d58945 None None] MFA Rules not processed for user `3771fe71ef624fd38dcaf2bff3751663`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:06.902011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-36ff3f9c-2b47-4930-8e63-bd73d9d58945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:06.953827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:06.989042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 684/1372] 10.222.0.93 () {58 vars in 1061 bytes} [Thu Aug 4 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:17:06.994775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb8ec8-3684-4194-894e-8e6325395410 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:06.996462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a2bb8ec8-3684-4194-894e-8e6325395410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:07.115921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb8ec8-3684-4194-894e-8e6325395410 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:07.161676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:07.196394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24829f65-97f5-4614-b0eb-ab9396b8723f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:07.203429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829f65-97f5-4614-b0eb-ab9396b8723f service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:07.203429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829f65-97f5-4614-b0eb-ab9396b8723f service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:07.203429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24829f65-97f5-4614-b0eb-ab9396b8723f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:07.203429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-24829f65-97f5-4614-b0eb-ab9396b8723f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:07.317044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24829f65-97f5-4614-b0eb-ab9396b8723f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:07.318499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24829f65-97f5-4614-b0eb-ab9396b8723f service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:07.343841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 689/1373] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:07.619798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b70c-7de3-4d93-afb6-38f38f2b7182 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:07.620405 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b70c-7de3-4d93-afb6-38f38f2b7182 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:07.620405 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b70c-7de3-4d93-afb6-38f38f2b7182 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:07.621987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 685/1374] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:07.627526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae05c0-d701-4fc8-9c0b-679fa1f8ccfc None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:07.628462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae05c0-d701-4fc8-9c0b-679fa1f8ccfc None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:07.628765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae05c0-d701-4fc8-9c0b-679fa1f8ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:07.708212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2aae05c0-d701-4fc8-9c0b-679fa1f8ccfc None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:07.709544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2aae05c0-d701-4fc8-9c0b-679fa1f8ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:07.731184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:07.822461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 690/1375] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:07.867959 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35b70c-7de3-4d93-afb6-38f38f2b7182 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:07.869513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3a35b70c-7de3-4d93-afb6-38f38f2b7182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:08.021339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35b70c-7de3-4d93-afb6-38f38f2b7182 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:08.075260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:08.139486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54fd6-c6d6-40c6-9f74-983aec4a6e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:08.140019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54fd6-c6d6-40c6-9f74-983aec4a6e02 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:08.140293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54fd6-c6d6-40c6-9f74-983aec4a6e02 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:08.140562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54fd6-c6d6-40c6-9f74-983aec4a6e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:08.142796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-87b54fd6-c6d6-40c6-9f74-983aec4a6e02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:08.237305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b54fd6-c6d6-40c6-9f74-983aec4a6e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:08.239201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b54fd6-c6d6-40c6-9f74-983aec4a6e02 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:08.259601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 686/1376] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:10.482425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8698-38d3-4203-a2a8-aa71573b1bdf None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:10.482961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8698-38d3-4203-a2a8-aa71573b1bdf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:10.482961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8698-38d3-4203-a2a8-aa71573b1bdf None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:10.484439 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 691/1377] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:10.492945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbdb74-a5c5-46de-8e1f-b2969fa13856 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:10.493415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbdb74-a5c5-46de-8e1f-b2969fa13856 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:10.493415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbdb74-a5c5-46de-8e1f-b2969fa13856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:10.568521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-8fcbdb74-a5c5-46de-8e1f-b2969fa13856 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:10.569828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8fcbdb74-a5c5-46de-8e1f-b2969fa13856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:10.577407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:10.699881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 687/1378] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:10.745960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b8698-38d3-4203-a2a8-aa71573b1bdf None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:10.747475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f37b8698-38d3-4203-a2a8-aa71573b1bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:10.903985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b8698-38d3-4203-a2a8-aa71573b1bdf None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:10.908579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:11.031215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae092bd3-f78b-497e-897a-01f7eb1de3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:11.032539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092bd3-f78b-497e-897a-01f7eb1de3e3 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:11.032945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092bd3-f78b-497e-897a-01f7eb1de3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:11.037067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae092bd3-f78b-497e-897a-01f7eb1de3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:11.041476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ae092bd3-f78b-497e-897a-01f7eb1de3e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:11.163218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae092bd3-f78b-497e-897a-01f7eb1de3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:11.164861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae092bd3-f78b-497e-897a-01f7eb1de3e3 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:11.185062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 692/1379] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:13.446877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c990-8756-498f-ba4f-28f28a4106f3 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:13.447461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c990-8756-498f-ba4f-28f28a4106f3 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:13.447461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c990-8756-498f-ba4f-28f28a4106f3 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:13.450017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 688/1380] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:13.455954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc172a-395e-4737-8442-06091443ab03 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:13.456411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc172a-395e-4737-8442-06091443ab03 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:13.456492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc172a-395e-4737-8442-06091443ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:13.468085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:13.534063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9acc172a-395e-4737-8442-06091443ab03 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:13.537831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9acc172a-395e-4737-8442-06091443ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:13.658120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 693/1381] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:13.697258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c990-8756-498f-ba4f-28f28a4106f3 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:13.698852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-17e1c990-8756-498f-ba4f-28f28a4106f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:13.858880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:13.870919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c990-8756-498f-ba4f-28f28a4106f3 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:13.996188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2fbd7-7a9d-46cc-a421-8c0b046e8e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:13.996729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fbd7-7a9d-46cc-a421-8c0b046e8e6d service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:13.997035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fbd7-7a9d-46cc-a421-8c0b046e8e6d service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:13.997312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fbd7-7a9d-46cc-a421-8c0b046e8e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:13.999002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e3d2fbd7-7a9d-46cc-a421-8c0b046e8e6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:14.111153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2fbd7-7a9d-46cc-a421-8c0b046e8e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:14.113181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2fbd7-7a9d-46cc-a421-8c0b046e8e6d service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:14.124784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:14.135639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 689/1382] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:16.693064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f295f-1b96-42d4-8185-3f33c63bbba1 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:16.693595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f295f-1b96-42d4-8185-3f33c63bbba1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:16.693843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f295f-1b96-42d4-8185-3f33c63bbba1 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:16.695302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 694/1383] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:16.702019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2028f99-457f-4899-a73b-a91a918cc699 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:16.702445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2028f99-457f-4899-a73b-a91a918cc699 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:16.702737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2028f99-457f-4899-a73b-a91a918cc699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:16.793729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f2028f99-457f-4899-a73b-a91a918cc699 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:16.795362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f2028f99-457f-4899-a73b-a91a918cc699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:16.904024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 690/1384] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:17:16.947952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f295f-1b96-42d4-8185-3f33c63bbba1 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:16.949633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-064f295f-1b96-42d4-8185-3f33c63bbba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:17.041063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:17.114262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f295f-1b96-42d4-8185-3f33c63bbba1 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:17.238865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88416691-6aa2-4319-ad4f-95f1112a2aa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:17.239489 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88416691-6aa2-4319-ad4f-95f1112a2aa9 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:17.239769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88416691-6aa2-4319-ad4f-95f1112a2aa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:17.240022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88416691-6aa2-4319-ad4f-95f1112a2aa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:17.241700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-88416691-6aa2-4319-ad4f-95f1112a2aa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:17.293138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:17.335997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88416691-6aa2-4319-ad4f-95f1112a2aa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:17.338015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88416691-6aa2-4319-ad4f-95f1112a2aa9 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:17.358338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 695/1385] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:19.401230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a79fe-629a-4233-a975-584216305c56 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:19.401760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a79fe-629a-4233-a975-584216305c56 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:19.401760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a79fe-629a-4233-a975-584216305c56 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:19.403472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 691/1386] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:19.409149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2954-1748-4f19-a524-41273543ca27 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:19.409746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2954-1748-4f19-a524-41273543ca27 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:19.409746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2954-1748-4f19-a524-41273543ca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:19.481272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0b3d2954-1748-4f19-a524-41273543ca27 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:19.482468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0b3d2954-1748-4f19-a524-41273543ca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:19.592486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 696/1387] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:19.639577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a79fe-629a-4233-a975-584216305c56 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:19.641963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7a8a79fe-629a-4233-a975-584216305c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:19.738418 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:19.817924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a79fe-629a-4233-a975-584216305c56 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:19.962829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56355fd-3395-40b1-a793-4f757e48ab8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:19.963601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56355fd-3395-40b1-a793-4f757e48ab8d service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:19.963997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56355fd-3395-40b1-a793-4f757e48ab8d service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:19.964380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56355fd-3395-40b1-a793-4f757e48ab8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:19.966113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c56355fd-3395-40b1-a793-4f757e48ab8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:20.023189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:20.082321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56355fd-3395-40b1-a793-4f757e48ab8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:20.084003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56355fd-3395-40b1-a793-4f757e48ab8d service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:20.106647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 692/1388] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:22.477835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d511a-af56-4f39-a780-2f79189fa2f9 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:22.478392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d511a-af56-4f39-a780-2f79189fa2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:22.478392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d511a-af56-4f39-a780-2f79189fa2f9 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:22.479754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 697/1389] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:22.485121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb580d-22a4-400c-9269-2ff5a618ea92 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:22.485603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb580d-22a4-400c-9269-2ff5a618ea92 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:22.485708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb580d-22a4-400c-9269-2ff5a618ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:22.569710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-8fdb580d-22a4-400c-9269-2ff5a618ea92 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:22.570969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8fdb580d-22a4-400c-9269-2ff5a618ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:22.685819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 693/1390] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:22.732579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d511a-af56-4f39-a780-2f79189fa2f9 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:22.734142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-430d511a-af56-4f39-a780-2f79189fa2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:22.768701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:22.889090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d511a-af56-4f39-a780-2f79189fa2f9 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:22.995581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:23.007790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8425-4e13-41a4-ba59-b87339a83d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:23.008417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8425-4e13-41a4-ba59-b87339a83d5f service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:23.008698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8425-4e13-41a4-ba59-b87339a83d5f service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:23.008999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8425-4e13-41a4-ba59-b87339a83d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:23.010634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-724b8425-4e13-41a4-ba59-b87339a83d5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:23.020522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633067f-d90e-405c-80ad-00d25284dc12 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:23.020706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633067f-d90e-405c-80ad-00d25284dc12 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:23.020856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633067f-d90e-405c-80ad-00d25284dc12 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:23.022267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 694/1391] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:17:23.027418 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162952-f865-4afa-9f83-aeb72997ed1a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:23.028023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162952-f865-4afa-9f83-aeb72997ed1a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:23.028375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162952-f865-4afa-9f83-aeb72997ed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:23.044479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:23.098176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-e6162952-f865-4afa-9f83-aeb72997ed1a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:23.099447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e6162952-f865-4afa-9f83-aeb72997ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:23.105027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8425-4e13-41a4-ba59-b87339a83d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:23.106618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8425-4e13-41a4-ba59-b87339a83d5f service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:23.126870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 698/1392] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:23.207261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 695/1393] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:23.264444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248d8c-da0a-44d4-b66a-1e79409ab329 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:23.264726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248d8c-da0a-44d4-b66a-1e79409ab329 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:23.265041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248d8c-da0a-44d4-b66a-1e79409ab329 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:23.267417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 699/1394] 10.222.0.93 () {54 vars in 966 bytes} [Thu Aug 4 21:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:17:23.272661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836a1d-ec6a-4add-85ad-40b75ad85d72 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:23.272914 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836a1d-ec6a-4add-85ad-40b75ad85d72 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:23.273207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836a1d-ec6a-4add-85ad-40b75ad85d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:23.351542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-60836a1d-ec6a-4add-85ad-40b75ad85d72 None None] MFA Rules not processed for user `3ad56212b530461cb19f1bb2b4b14027`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:23.352926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-60836a1d-ec6a-4add-85ad-40b75ad85d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:23.396279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:23.446868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 696/1395] 10.222.0.93 () {58 vars in 1063 bytes} [Thu Aug 4 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:17:23.455781 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08248d8c-da0a-44d4-b66a-1e79409ab329 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:23.457335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-08248d8c-da0a-44d4-b66a-1e79409ab329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:23.571402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08248d8c-da0a-44d4-b66a-1e79409ab329 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:23.584964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:23.648212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff71fc9-e214-4010-97bd-badd83faa64b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad56212b530461cb19f1bb2b4b14027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:23.648830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71fc9-e214-4010-97bd-badd83faa64b service glance] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:23.649134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71fc9-e214-4010-97bd-badd83faa64b service glance] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:23.649403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71fc9-e214-4010-97bd-badd83faa64b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:23.651010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-eff71fc9-e214-4010-97bd-badd83faa64b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:23.773720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff71fc9-e214-4010-97bd-badd83faa64b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:23.775140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff71fc9-e214-4010-97bd-badd83faa64b service glance] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:23.795005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 700/1396] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:24.683339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74ee0-c453-49ee-bfab-1e6615a3b543 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:24.683842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74ee0-c453-49ee-bfab-1e6615a3b543 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:24.683965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74ee0-c453-49ee-bfab-1e6615a3b543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:24.758826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-73e74ee0-c453-49ee-bfab-1e6615a3b543 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:24.760035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-73e74ee0-c453-49ee-bfab-1e6615a3b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:24.851515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 697/1397] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:24.895902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8783ef-94c9-4004-89c3-b17fc4ca6b77 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:24.896429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8783ef-94c9-4004-89c3-b17fc4ca6b77 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:24.896429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8783ef-94c9-4004-89c3-b17fc4ca6b77 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:24.897851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 701/1398] 10.222.0.93 () {54 vars in 943 bytes} [Thu Aug 4 21:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:24.904527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee22d98-e8ef-4192-b7b0-0cd5e9156bf4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:24.904895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee22d98-e8ef-4192-b7b0-0cd5e9156bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:24.905252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee22d98-e8ef-4192-b7b0-0cd5e9156bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:24.966220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:24.985675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1ee22d98-e8ef-4192-b7b0-0cd5e9156bf4 None None] MFA Rules not processed for user `348efd4e6a0948afb8b0015d9bfb1d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:24.986903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1ee22d98-e8ef-4192-b7b0-0cd5e9156bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:25.128046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 698/1399] 10.222.0.93 () {58 vars in 1040 bytes} [Thu Aug 4 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:25.137588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8783ef-94c9-4004-89c3-b17fc4ca6b77 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:25.139399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7a8783ef-94c9-4004-89c3-b17fc4ca6b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:25.196487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:25.308807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8783ef-94c9-4004-89c3-b17fc4ca6b77 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:25.393868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab68db-18b5-4e2d-a05d-7575126d43e0 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:25.393868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab68db-18b5-4e2d-a05d-7575126d43e0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:25.393868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab68db-18b5-4e2d-a05d-7575126d43e0 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:25.393868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 699/1400] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:17:25.393868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0177439-3fe6-4237-97e1-8155386096e7 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:25.393868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0177439-3fe6-4237-97e1-8155386096e7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:25.394585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0177439-3fe6-4237-97e1-8155386096e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:25.425233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:25.426341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:25.426702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:25.427018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:25.429052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:25.468652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f0177439-3fe6-4237-97e1-8155386096e7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:25.470788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f0177439-3fe6-4237-97e1-8155386096e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:25.530919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:25.534324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:25.549621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 702/1401] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:17:25.553673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:25.613280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 700/1402] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:25.662198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:25.663413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:25.703386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:25.771229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa6967-aeba-4406-b879-2651588f97d7 service swift] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:25.897756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cb9c7-3e71-4fc3-b84e-c9c9503cc77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:25.898488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cb9c7-3e71-4fc3-b84e-c9c9503cc77b service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:25.898639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cb9c7-3e71-4fc3-b84e-c9c9503cc77b service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:25.898910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cb9c7-3e71-4fc3-b84e-c9c9503cc77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:25.900548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-284cb9c7-3e71-4fc3-b84e-c9c9503cc77b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:25.996558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cb9c7-3e71-4fc3-b84e-c9c9503cc77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:25.998171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cb9c7-3e71-4fc3-b84e-c9c9503cc77b service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:26.016517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 703/1403] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:26.217754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:28.383779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8bfd-3591-490e-aeb0-f74c664d9174 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:28.383779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8bfd-3591-490e-aeb0-f74c664d9174 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:28.383779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8bfd-3591-490e-aeb0-f74c664d9174 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:28.384878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 701/1404] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:28.390926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161042e-b39b-4487-8410-0cf54e360853 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:28.391450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161042e-b39b-4487-8410-0cf54e360853 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:28.391578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161042e-b39b-4487-8410-0cf54e360853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:28.467991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0161042e-b39b-4487-8410-0cf54e360853 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:28.469829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0161042e-b39b-4487-8410-0cf54e360853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:28.512256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:28.600953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 704/1405] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:28.635477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f8bfd-3591-490e-aeb0-f74c664d9174 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:28.637030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fc0f8bfd-3591-490e-aeb0-f74c664d9174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:28.814079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f8bfd-3591-490e-aeb0-f74c664d9174 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:28.877551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:28.966288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c46e25-64d6-4108-81af-f730ebd1bbcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:28.967097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46e25-64d6-4108-81af-f730ebd1bbcc service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:28.967404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46e25-64d6-4108-81af-f730ebd1bbcc service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:28.967689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46e25-64d6-4108-81af-f730ebd1bbcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:28.970531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-85c46e25-64d6-4108-81af-f730ebd1bbcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:29.080458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c46e25-64d6-4108-81af-f730ebd1bbcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:29.082319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c46e25-64d6-4108-81af-f730ebd1bbcc service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:29.102812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 702/1406] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:31.358319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f348d-a2f6-4728-b576-439d6d9e7a81 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:31.358896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f348d-a2f6-4728-b576-439d6d9e7a81 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:31.358896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f348d-a2f6-4728-b576-439d6d9e7a81 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:31.361028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 705/1407] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:31.366611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7e59-b3eb-4904-8caa-152c121e99b2 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:31.367094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7e59-b3eb-4904-8caa-152c121e99b2 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:31.367177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7e59-b3eb-4904-8caa-152c121e99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:31.433331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:31.442389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-cd5f7e59-b3eb-4904-8caa-152c121e99b2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:31.446618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cd5f7e59-b3eb-4904-8caa-152c121e99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:31.559894 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 703/1408] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:17:31.607845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f348d-a2f6-4728-b576-439d6d9e7a81 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:31.610365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-466f348d-a2f6-4728-b576-439d6d9e7a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:31.776256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f348d-a2f6-4728-b576-439d6d9e7a81 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:31.798588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:31.910840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242e133-df3e-45a0-b77a-009db086592b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:31.911504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e133-df3e-45a0-b77a-009db086592b service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:31.911863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e133-df3e-45a0-b77a-009db086592b service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:31.912207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e133-df3e-45a0-b77a-009db086592b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:31.913959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6242e133-df3e-45a0-b77a-009db086592b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:32.021586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242e133-df3e-45a0-b77a-009db086592b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:32.023795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242e133-df3e-45a0-b77a-009db086592b service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:32.045296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 706/1409] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:41.558001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=44 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:42.042705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:50.806665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0f0ad-6670-4390-af70-64746c1048ca None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:50.807240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0f0ad-6670-4390-af70-64746c1048ca None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:50.807240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0f0ad-6670-4390-af70-64746c1048ca None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:50.808576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 704/1410] 10.222.0.93 () {54 vars in 918 bytes} [Thu Aug 4 21:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:50.814541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335454f-5066-4bb0-b0a8-500aee8ba495 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:50.815080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335454f-5066-4bb0-b0a8-500aee8ba495 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:50.815080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335454f-5066-4bb0-b0a8-500aee8ba495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:50.892606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6335454f-5066-4bb0-b0a8-500aee8ba495 None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:50.893871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6335454f-5066-4bb0-b0a8-500aee8ba495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:51.002107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 707/1411] 10.222.0.93 () {58 vars in 1015 bytes} [Thu Aug 4 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:17:51.017504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531d357-8818-4bc5-8288-275af4f942a5 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:51.017962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531d357-8818-4bc5-8288-275af4f942a5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:51.018469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531d357-8818-4bc5-8288-275af4f942a5 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:51.027883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 705/1412] 10.222.0.93 () {54 vars in 918 bytes} [Thu Aug 4 21:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:51.028002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbdc8-b98b-4e07-8e79-3013bddf6f41 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:51.028002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbdc8-b98b-4e07-8e79-3013bddf6f41 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:51.028002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbdc8-b98b-4e07-8e79-3013bddf6f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:51.099728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:51.102210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ac3dbdc8-b98b-4e07-8e79-3013bddf6f41 None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:51.103427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ac3dbdc8-b98b-4e07-8e79-3013bddf6f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:51.221540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 708/1413] 10.222.0.93 () {58 vars in 1015 bytes} [Thu Aug 4 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:17:53.765050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45277-1463-4d9b-8529-bfe6c1441bb3 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:53.765658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45277-1463-4d9b-8529-bfe6c1441bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:53.765658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb45277-1463-4d9b-8529-bfe6c1441bb3 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:53.767085 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:53.772719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d56f3-0308-4c68-8da3-f4bf6e46ddbe None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:53.773222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d56f3-0308-4c68-8da3-f4bf6e46ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:53.773328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d56f3-0308-4c68-8da3-f4bf6e46ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:53.843417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-319d56f3-0308-4c68-8da3-f4bf6e46ddbe None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:53.844654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-319d56f3-0308-4c68-8da3-f4bf6e46ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:53.902502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:53.947249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:53.991131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45277-1463-4d9b-8529-bfe6c1441bb3 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:53.992667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0fb45277-1463-4d9b-8529-bfe6c1441bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:54.142269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb45277-1463-4d9b-8529-bfe6c1441bb3 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:54.218583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:54.258829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c223d-147a-4bad-95ca-ee8daa9a4d98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:54.259451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c223d-147a-4bad-95ca-ee8daa9a4d98 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:54.259801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c223d-147a-4bad-95ca-ee8daa9a4d98 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:54.260084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c223d-147a-4bad-95ca-ee8daa9a4d98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:54.261771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-2c4c223d-147a-4bad-95ca-ee8daa9a4d98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:54.352467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c223d-147a-4bad-95ca-ee8daa9a4d98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:54.354087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c223d-147a-4bad-95ca-ee8daa9a4d98 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:54.372417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 707/1416] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:55.306754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840363a1-bf45-4ed6-8242-af9863c6615f None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:55.307361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840363a1-bf45-4ed6-8242-af9863c6615f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:55.307469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840363a1-bf45-4ed6-8242-af9863c6615f None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:55.309121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:55.315457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798595c8-eba7-473a-b907-0253388b4755 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:55.315924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798595c8-eba7-473a-b907-0253388b4755 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:55.316043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798595c8-eba7-473a-b907-0253388b4755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:55.395780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-798595c8-eba7-473a-b907-0253388b4755 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:55.397023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-798595c8-eba7-473a-b907-0253388b4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:55.425698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:55.498095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:55.649501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840363a1-bf45-4ed6-8242-af9863c6615f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:55.651091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-840363a1-bf45-4ed6-8242-af9863c6615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:55.802473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840363a1-bf45-4ed6-8242-af9863c6615f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:55.844225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:55.923716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a969c3b-2c14-4647-bd13-0bd7f3952e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:55.924333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969c3b-2c14-4647-bd13-0bd7f3952e03 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:55.924615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969c3b-2c14-4647-bd13-0bd7f3952e03 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:55.924929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969c3b-2c14-4647-bd13-0bd7f3952e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:55.926546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8a969c3b-2c14-4647-bd13-0bd7f3952e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:56.016303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a969c3b-2c14-4647-bd13-0bd7f3952e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:56.017924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a969c3b-2c14-4647-bd13-0bd7f3952e03 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:56.037401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 711/1419] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:56.947962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c2aec-754d-42cd-8787-a304b579e72a None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:56.948440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c2aec-754d-42cd-8787-a304b579e72a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:56.948549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c2aec-754d-42cd-8787-a304b579e72a None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:56.949915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:56.955015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52961-35bd-430e-98ec-3b814896a519 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:56.955429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52961-35bd-430e-98ec-3b814896a519 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:56.955535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f52961-35bd-430e-98ec-3b814896a519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:57.010986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:57.033741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f4f52961-35bd-430e-98ec-3b814896a519 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:57.034946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f4f52961-35bd-430e-98ec-3b814896a519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:57.138923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:57.295368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c2aec-754d-42cd-8787-a304b579e72a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:57.297027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b52c2aec-754d-42cd-8787-a304b579e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:57.446510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c2aec-754d-42cd-8787-a304b579e72a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:57.459276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:57.563839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783c1d7-7a31-4571-b5fb-8e00ad880f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:57.564384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c1d7-7a31-4571-b5fb-8e00ad880f0a service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:57.564668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c1d7-7a31-4571-b5fb-8e00ad880f0a service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:57.564979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c1d7-7a31-4571-b5fb-8e00ad880f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:57.566610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b783c1d7-7a31-4571-b5fb-8e00ad880f0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:57.658678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783c1d7-7a31-4571-b5fb-8e00ad880f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:57.660372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783c1d7-7a31-4571-b5fb-8e00ad880f0a service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:57.678838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 710/1422] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:58.556625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45af054-4dba-4e79-95a6-8ae1b62531c4 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:58.557174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45af054-4dba-4e79-95a6-8ae1b62531c4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:58.557174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45af054-4dba-4e79-95a6-8ae1b62531c4 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:58.558617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:17:58.564397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41c0b-6873-4a89-8c9c-422c14c2a964 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:58.564928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41c0b-6873-4a89-8c9c-422c14c2a964 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:58.565027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a41c0b-6873-4a89-8c9c-422c14c2a964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:58.585993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:58.643262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f3a41c0b-6873-4a89-8c9c-422c14c2a964 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:17:58.644480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f3a41c0b-6873-4a89-8c9c-422c14c2a964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:58.740610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:17:58.897260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45af054-4dba-4e79-95a6-8ae1b62531c4 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:17:58.898855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c45af054-4dba-4e79-95a6-8ae1b62531c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:59.013442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:59.051362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45af054-4dba-4e79-95a6-8ae1b62531c4 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:17:59.165232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cff97-21e2-4602-8b85-d11a57d76224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:17:59.165778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cff97-21e2-4602-8b85-d11a57d76224 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:17:59.166055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cff97-21e2-4602-8b85-d11a57d76224 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:17:59.166330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cff97-21e2-4602-8b85-d11a57d76224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:17:59.167956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-195cff97-21e2-4602-8b85-d11a57d76224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:17:59.245454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:17:59.260278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cff97-21e2-4602-8b85-d11a57d76224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:17:59.262008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cff97-21e2-4602-8b85-d11a57d76224 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:17:59.282109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 714/1425] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:00.171735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9d0c-4563-48a3-ae78-7a020714931e None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:00.172325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9d0c-4563-48a3-ae78-7a020714931e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:00.172325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9d0c-4563-48a3-ae78-7a020714931e None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:00.173689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:00.179518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4413-47a2-493e-8cec-b07f53fac4bf None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:00.179961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4413-47a2-493e-8cec-b07f53fac4bf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:00.180074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4413-47a2-493e-8cec-b07f53fac4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:00.257565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-201d4413-47a2-493e-8cec-b07f53fac4bf None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:00.258783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-201d4413-47a2-493e-8cec-b07f53fac4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:00.373267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:00.539625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e9d0c-4563-48a3-ae78-7a020714931e None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:00.541314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e12e9d0c-4563-48a3-ae78-7a020714931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:00.633262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:00.726553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e9d0c-4563-48a3-ae78-7a020714931e None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:00.856933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a309d6e-ed37-4b04-94e9-379bb641e18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:00.857585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309d6e-ed37-4b04-94e9-379bb641e18f service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:00.857865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309d6e-ed37-4b04-94e9-379bb641e18f service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:00.858793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a309d6e-ed37-4b04-94e9-379bb641e18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:00.861180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9a309d6e-ed37-4b04-94e9-379bb641e18f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:00.914706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:00.958170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a309d6e-ed37-4b04-94e9-379bb641e18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:00.959845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a309d6e-ed37-4b04-94e9-379bb641e18f service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:00.978616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 713/1428] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:01.868520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1ca61-8e68-4d30-a14c-ecde0bb45e0e None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:01.869100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1ca61-8e68-4d30-a14c-ecde0bb45e0e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:01.869100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1ca61-8e68-4d30-a14c-ecde0bb45e0e None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:01.870449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:01.875555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0011a6-c4a5-406a-a3ea-80a2eb2e73c1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:01.875974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0011a6-c4a5-406a-a3ea-80a2eb2e73c1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:01.876091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0011a6-c4a5-406a-a3ea-80a2eb2e73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:01.951380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9b0011a6-c4a5-406a-a3ea-80a2eb2e73c1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:01.953158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9b0011a6-c4a5-406a-a3ea-80a2eb2e73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:02.052868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:02.208580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1ca61-8e68-4d30-a14c-ecde0bb45e0e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:02.210088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-05f1ca61-8e68-4d30-a14c-ecde0bb45e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:02.261292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:02.361557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1ca61-8e68-4d30-a14c-ecde0bb45e0e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:02.488347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245b88f-710a-4aa2-bedd-c6df25785ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:02.488925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b88f-710a-4aa2-bedd-c6df25785ef2 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:02.489203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b88f-710a-4aa2-bedd-c6df25785ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:02.489479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b88f-710a-4aa2-bedd-c6df25785ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:02.491142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f245b88f-710a-4aa2-bedd-c6df25785ef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:02.499290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:02.587038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245b88f-710a-4aa2-bedd-c6df25785ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:02.588616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245b88f-710a-4aa2-bedd-c6df25785ef2 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:02.607059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 717/1431] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:03.512700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e813c-e159-48f3-a259-ca3aa8da1ae1 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:03.513220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e813c-e159-48f3-a259-ca3aa8da1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:03.513339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e813c-e159-48f3-a259-ca3aa8da1ae1 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:03.515285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:03.520485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749dd05-2c2b-4f78-a44e-312ed4e3e389 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:03.520951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749dd05-2c2b-4f78-a44e-312ed4e3e389 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:03.521073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749dd05-2c2b-4f78-a44e-312ed4e3e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:03.596506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3749dd05-2c2b-4f78-a44e-312ed4e3e389 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:03.597775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3749dd05-2c2b-4f78-a44e-312ed4e3e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:03.667053 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:03.698217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:03.857508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e813c-e159-48f3-a259-ca3aa8da1ae1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:03.859222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e16e813c-e159-48f3-a259-ca3aa8da1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:03.877889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:04.011535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e813c-e159-48f3-a259-ca3aa8da1ae1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:04.100343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:04.126655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf672f9-be47-46d6-8112-1db36df29499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:04.127274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf672f9-be47-46d6-8112-1db36df29499 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:04.127554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf672f9-be47-46d6-8112-1db36df29499 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:04.127833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf672f9-be47-46d6-8112-1db36df29499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:04.129501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fdf672f9-be47-46d6-8112-1db36df29499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:04.220630 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf672f9-be47-46d6-8112-1db36df29499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:04.222270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf672f9-be47-46d6-8112-1db36df29499 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:04.240509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 716/1434] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:05.091869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089de3b1-e07c-4787-988b-8e7204f805c6 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:05.093152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089de3b1-e07c-4787-988b-8e7204f805c6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:05.093152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089de3b1-e07c-4787-988b-8e7204f805c6 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:05.094503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:05.099406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683284eb-63df-4ebf-a68f-d2cac712943e None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:05.099826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683284eb-63df-4ebf-a68f-d2cac712943e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:05.100055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683284eb-63df-4ebf-a68f-d2cac712943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:05.177867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-683284eb-63df-4ebf-a68f-d2cac712943e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:05.179084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-683284eb-63df-4ebf-a68f-d2cac712943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:05.220966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:05.276644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:05.427109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089de3b1-e07c-4787-988b-8e7204f805c6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:05.428539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-089de3b1-e07c-4787-988b-8e7204f805c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:05.572579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089de3b1-e07c-4787-988b-8e7204f805c6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:05.626309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:05.684850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1eef-147a-4ff0-af80-04488223a56f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:05.685414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1eef-147a-4ff0-af80-04488223a56f service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:05.685688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1eef-147a-4ff0-af80-04488223a56f service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:05.686644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1eef-147a-4ff0-af80-04488223a56f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:05.689009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-38fd1eef-147a-4ff0-af80-04488223a56f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:05.777892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1eef-147a-4ff0-af80-04488223a56f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:05.779543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1eef-147a-4ff0-af80-04488223a56f service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:05.798517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 720/1437] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:06.691777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221ce23-766e-4f34-900e-561363503ce9 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:06.692311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221ce23-766e-4f34-900e-561363503ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:06.692311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221ce23-766e-4f34-900e-561363503ce9 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:06.693680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:06.698521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa06e-c17c-49bd-9b1c-1cd3f00a0822 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:06.698980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa06e-c17c-49bd-9b1c-1cd3f00a0822 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:06.699078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa06e-c17c-49bd-9b1c-1cd3f00a0822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:06.775795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-8fafa06e-c17c-49bd-9b1c-1cd3f00a0822 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:06.777328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8fafa06e-c17c-49bd-9b1c-1cd3f00a0822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:06.779508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:06.879084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:07.033497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221ce23-766e-4f34-900e-561363503ce9 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:07.035048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d221ce23-766e-4f34-900e-561363503ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:07.182120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221ce23-766e-4f34-900e-561363503ce9 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:07.208785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:07.294960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8249e17-bf36-4af7-a6aa-45efbf378397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:07.296007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249e17-bf36-4af7-a6aa-45efbf378397 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:07.296993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249e17-bf36-4af7-a6aa-45efbf378397 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:07.296993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249e17-bf36-4af7-a6aa-45efbf378397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:07.298376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b8249e17-bf36-4af7-a6aa-45efbf378397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:07.387075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8249e17-bf36-4af7-a6aa-45efbf378397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:07.388695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8249e17-bf36-4af7-a6aa-45efbf378397 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:07.407268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 719/1440] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:09.349260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268d17-7d77-44ba-a1d5-38cd1780933f None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:09.349825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268d17-7d77-44ba-a1d5-38cd1780933f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:09.349825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268d17-7d77-44ba-a1d5-38cd1780933f None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:09.351203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:09.356847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb369cd-5e1a-41be-9048-254446d97eb0 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:09.359307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb369cd-5e1a-41be-9048-254446d97eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:09.359307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb369cd-5e1a-41be-9048-254446d97eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:09.401325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:09.431371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-bfb369cd-5e1a-41be-9048-254446d97eb0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:09.434016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bfb369cd-5e1a-41be-9048-254446d97eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:09.540868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:09.580395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91268d17-7d77-44ba-a1d5-38cd1780933f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:09.581976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-91268d17-7d77-44ba-a1d5-38cd1780933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:09.699459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91268d17-7d77-44ba-a1d5-38cd1780933f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:09.735638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:09.785174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ef052-147a-46a5-b95d-ce4ca1f45f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:09.785960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ef052-147a-46a5-b95d-ce4ca1f45f23 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:09.786240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ef052-147a-46a5-b95d-ce4ca1f45f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:09.786878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ef052-147a-46a5-b95d-ce4ca1f45f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:09.788268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-975ef052-147a-46a5-b95d-ce4ca1f45f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:09.910751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ef052-147a-46a5-b95d-ce4ca1f45f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:09.912200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ef052-147a-46a5-b95d-ce4ca1f45f23 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:09.938592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 723/1443] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:12.190206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013982-977b-422b-8f7b-31cc47ae11cb None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:12.190771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013982-977b-422b-8f7b-31cc47ae11cb None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:12.190771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013982-977b-422b-8f7b-31cc47ae11cb None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:12.192120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:12.197251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd4a1-d52e-4b7a-b1ec-b445310f3b29 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:12.197673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd4a1-d52e-4b7a-b1ec-b445310f3b29 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:12.197785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd4a1-d52e-4b7a-b1ec-b445310f3b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:12.267720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c5dfd4a1-d52e-4b7a-b1ec-b445310f3b29 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:12.269001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c5dfd4a1-d52e-4b7a-b1ec-b445310f3b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:12.283782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:12.369804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:12.408803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013982-977b-422b-8f7b-31cc47ae11cb None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:12.410407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-93013982-977b-422b-8f7b-31cc47ae11cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:12.516084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013982-977b-422b-8f7b-31cc47ae11cb None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:12.528850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:12.714442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1419bb-f27c-4e4c-b9f3-d9c6140336b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:12.715054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1419bb-f27c-4e4c-b9f3-d9c6140336b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:12.715332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1419bb-f27c-4e4c-b9f3-d9c6140336b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:12.715604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1419bb-f27c-4e4c-b9f3-d9c6140336b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:12.717874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ef1419bb-f27c-4e4c-b9f3-d9c6140336b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:12.833926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1419bb-f27c-4e4c-b9f3-d9c6140336b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:12.835507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1419bb-f27c-4e4c-b9f3-d9c6140336b9 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:12.854240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 722/1446] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:15.240237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3d07-31e8-488d-b0e2-faf4bca7a22b None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:15.240806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3d07-31e8-488d-b0e2-faf4bca7a22b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:15.240806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3d07-31e8-488d-b0e2-faf4bca7a22b None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:15.242150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:15.247425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05997eb1-ca65-4c83-a728-570839d1c51d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:15.247849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05997eb1-ca65-4c83-a728-570839d1c51d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:15.247978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05997eb1-ca65-4c83-a728-570839d1c51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:15.297735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:15.315953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-05997eb1-ca65-4c83-a728-570839d1c51d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:15.317204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-05997eb1-ca65-4c83-a728-570839d1c51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:15.413603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:15.453848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc3d07-31e8-488d-b0e2-faf4bca7a22b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:15.455440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3fdc3d07-31e8-488d-b0e2-faf4bca7a22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:15.559826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc3d07-31e8-488d-b0e2-faf4bca7a22b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:15.600029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:15.634238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0470-48fa-424f-8913-88e28b0a5a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:15.634847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0470-48fa-424f-8913-88e28b0a5a3f service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:15.635122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0470-48fa-424f-8913-88e28b0a5a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:15.635396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0470-48fa-424f-8913-88e28b0a5a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:15.637029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cf0d0470-48fa-424f-8913-88e28b0a5a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:15.747223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0470-48fa-424f-8913-88e28b0a5a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:15.749572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0470-48fa-424f-8913-88e28b0a5a3f service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:15.769275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 726/1449] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:17.913152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbcdac-993b-4f41-ba70-68dcd939097b None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:17.913569 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbcdac-993b-4f41-ba70-68dcd939097b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:17.913709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbcdac-993b-4f41-ba70-68dcd939097b None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:17.915087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:17.920729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584020-69d6-422d-8032-ae0f001858cb None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:17.921227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584020-69d6-422d-8032-ae0f001858cb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:17.921688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584020-69d6-422d-8032-ae0f001858cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:17.988990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ed584020-69d6-422d-8032-ae0f001858cb None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:17.990202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ed584020-69d6-422d-8032-ae0f001858cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:18.012283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:18.088877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:18.128933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbcdac-993b-4f41-ba70-68dcd939097b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:18.130495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-57fbcdac-993b-4f41-ba70-68dcd939097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:18.233183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbcdac-993b-4f41-ba70-68dcd939097b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:18.254213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:18.311032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a44be7-688c-4872-9276-8f0e69124d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:18.311749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44be7-688c-4872-9276-8f0e69124d26 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:18.312051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44be7-688c-4872-9276-8f0e69124d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:18.312832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a44be7-688c-4872-9276-8f0e69124d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:18.314640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-70a44be7-688c-4872-9276-8f0e69124d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:18.422353 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a44be7-688c-4872-9276-8f0e69124d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:18.423800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a44be7-688c-4872-9276-8f0e69124d26 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:18.442660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 725/1452] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:20.532906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f12cc-758d-47a0-93c0-1d981dbcbaba None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:20.533407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f12cc-758d-47a0-93c0-1d981dbcbaba None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:20.533530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f12cc-758d-47a0-93c0-1d981dbcbaba None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:20.534831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:20.540271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a736b-734f-4914-b8b0-54902b01c176 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:20.540660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a736b-734f-4914-b8b0-54902b01c176 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:20.540750 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a736b-734f-4914-b8b0-54902b01c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:20.603883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:20.606607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-fd8a736b-734f-4914-b8b0-54902b01c176 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:20.607823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fd8a736b-734f-4914-b8b0-54902b01c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:20.709204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:20.747294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f12cc-758d-47a0-93c0-1d981dbcbaba None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:20.748870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-353f12cc-758d-47a0-93c0-1d981dbcbaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:20.854864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f12cc-758d-47a0-93c0-1d981dbcbaba None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:20.902905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:20.927731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271780e-9711-43c9-9595-cdf61efca473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:20.928372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271780e-9711-43c9-9595-cdf61efca473 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:20.928637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271780e-9711-43c9-9595-cdf61efca473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:20.928927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271780e-9711-43c9-9595-cdf61efca473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:20.930556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8271780e-9711-43c9-9595-cdf61efca473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:21.044814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271780e-9711-43c9-9595-cdf61efca473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:21.046326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271780e-9711-43c9-9595-cdf61efca473 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:21.065061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 729/1455] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:23.164941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15b3b-6dab-4387-9edb-76d585e3b38f None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:23.165568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15b3b-6dab-4387-9edb-76d585e3b38f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:23.165568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15b3b-6dab-4387-9edb-76d585e3b38f None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:23.166788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:23.172096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e9ed-ba3d-4bd5-ac72-555f48114b83 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:23.172557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e9ed-ba3d-4bd5-ac72-555f48114b83 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:23.172649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e9ed-ba3d-4bd5-ac72-555f48114b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:23.238917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9f00e9ed-ba3d-4bd5-ac72-555f48114b83 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:23.240205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9f00e9ed-ba3d-4bd5-ac72-555f48114b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:23.270310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:23.338730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:18:23.378174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15b3b-6dab-4387-9edb-76d585e3b38f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:23.379713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d0e15b3b-6dab-4387-9edb-76d585e3b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:23.482772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15b3b-6dab-4387-9edb-76d585e3b38f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:23.511610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:23.559711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691ced1-8f7f-46f2-bb9a-8e1ce8c79192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:23.560352 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ced1-8f7f-46f2-bb9a-8e1ce8c79192 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:23.560625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ced1-8f7f-46f2-bb9a-8e1ce8c79192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:23.560908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691ced1-8f7f-46f2-bb9a-8e1ce8c79192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:23.563327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a691ced1-8f7f-46f2-bb9a-8e1ce8c79192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:23.671679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691ced1-8f7f-46f2-bb9a-8e1ce8c79192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:23.673178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691ced1-8f7f-46f2-bb9a-8e1ce8c79192 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:23.692396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 728/1458] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:18:25.782705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5d7d-3648-4354-a029-c324e3db5bdf None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:25.783265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5d7d-3648-4354-a029-c324e3db5bdf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:25.783265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5d7d-3648-4354-a029-c324e3db5bdf None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:25.784677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:25.790056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a83413-6832-47bf-9f8f-ad2063909783 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:25.790509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a83413-6832-47bf-9f8f-ad2063909783 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:25.790611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a83413-6832-47bf-9f8f-ad2063909783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:25.856630 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-84a83413-6832-47bf-9f8f-ad2063909783 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:25.857967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-84a83413-6832-47bf-9f8f-ad2063909783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:25.866217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:25.955330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:25.992838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5d7d-3648-4354-a029-c324e3db5bdf None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:25.994409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fd0a5d7d-3648-4354-a029-c324e3db5bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:26.099923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5d7d-3648-4354-a029-c324e3db5bdf None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:26.157564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:26.175875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c1b0b-bac8-4390-9387-a0c23a412c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:26.176642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c1b0b-bac8-4390-9387-a0c23a412c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:26.176946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c1b0b-bac8-4390-9387-a0c23a412c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:26.177221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c1b0b-bac8-4390-9387-a0c23a412c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:26.178836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b98c1b0b-bac8-4390-9387-a0c23a412c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:26.308901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c1b0b-bac8-4390-9387-a0c23a412c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:26.310354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c1b0b-bac8-4390-9387-a0c23a412c95 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:26.329724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 732/1461] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:28.400497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0af47-5b17-4a5f-82cd-ad3e36a69215 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:28.401082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0af47-5b17-4a5f-82cd-ad3e36a69215 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:28.401082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0af47-5b17-4a5f-82cd-ad3e36a69215 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:28.402659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:28.408588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a537c9-beef-4c32-b112-9c8c4a5c5ff8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:28.409049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a537c9-beef-4c32-b112-9c8c4a5c5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:28.409156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a537c9-beef-4c32-b112-9c8c4a5c5ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:28.475002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c7a537c9-beef-4c32-b112-9c8c4a5c5ff8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:28.476205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c7a537c9-beef-4c32-b112-9c8c4a5c5ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:28.516646 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:28.575065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:28.613875 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0af47-5b17-4a5f-82cd-ad3e36a69215 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:28.615415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cce0af47-5b17-4a5f-82cd-ad3e36a69215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:28.718338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0af47-5b17-4a5f-82cd-ad3e36a69215 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:28.756243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:28.793195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724f1fe-c9ba-4671-a637-7b762f74f711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:28.793813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f1fe-c9ba-4671-a637-7b762f74f711 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:28.794106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f1fe-c9ba-4671-a637-7b762f74f711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:28.794364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724f1fe-c9ba-4671-a637-7b762f74f711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:28.796508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d724f1fe-c9ba-4671-a637-7b762f74f711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:28.909324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724f1fe-c9ba-4671-a637-7b762f74f711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:28.910814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724f1fe-c9ba-4671-a637-7b762f74f711 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:28.928647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 731/1464] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:30.986036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab2b9-ee54-40a1-9477-b186c766d344 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:30.986636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab2b9-ee54-40a1-9477-b186c766d344 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:30.986636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab2b9-ee54-40a1-9477-b186c766d344 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:30.987836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:30.993224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d34b-4e07-4624-8d5a-19d060735b28 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:30.993673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d34b-4e07-4624-8d5a-19d060735b28 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:30.993810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d34b-4e07-4624-8d5a-19d060735b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:31.059242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-0634d34b-4e07-4624-8d5a-19d060735b28 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:31.060432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0634d34b-4e07-4624-8d5a-19d060735b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:31.078954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:31.158627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:31.196238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edab2b9-ee54-40a1-9477-b186c766d344 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:31.197878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1edab2b9-ee54-40a1-9477-b186c766d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:31.301025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edab2b9-ee54-40a1-9477-b186c766d344 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:31.369118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:31.375762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546aa79-e2de-419f-99d4-6d4f102e29a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:31.376376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546aa79-e2de-419f-99d4-6d4f102e29a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:31.376654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546aa79-e2de-419f-99d4-6d4f102e29a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:31.376948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546aa79-e2de-419f-99d4-6d4f102e29a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:31.378565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3546aa79-e2de-419f-99d4-6d4f102e29a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:31.489799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546aa79-e2de-419f-99d4-6d4f102e29a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:31.491242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546aa79-e2de-419f-99d4-6d4f102e29a2 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:31.510592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 735/1467] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:33.533872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc797a-354c-411a-a62a-a0bf04e1f2d4 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:33.534382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc797a-354c-411a-a62a-a0bf04e1f2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:33.534478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc797a-354c-411a-a62a-a0bf04e1f2d4 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:33.535771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:33.541193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f10bbf-1b1f-4dce-bb7b-b8b4b04cc341 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:33.541619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f10bbf-1b1f-4dce-bb7b-b8b4b04cc341 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:33.541771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f10bbf-1b1f-4dce-bb7b-b8b4b04cc341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:33.607885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-78f10bbf-1b1f-4dce-bb7b-b8b4b04cc341 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:33.609192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-78f10bbf-1b1f-4dce-bb7b-b8b4b04cc341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:33.657278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:33.706061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:33.743768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc797a-354c-411a-a62a-a0bf04e1f2d4 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:33.745383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6bbc797a-354c-411a-a62a-a0bf04e1f2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:33.854900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc797a-354c-411a-a62a-a0bf04e1f2d4 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:33.909112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:33.935382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143bc91-ccf6-49d2-b897-6a1a7a3a75e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:33.937223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143bc91-ccf6-49d2-b897-6a1a7a3a75e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:33.937223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143bc91-ccf6-49d2-b897-6a1a7a3a75e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:33.937543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143bc91-ccf6-49d2-b897-6a1a7a3a75e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:33.939059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1143bc91-ccf6-49d2-b897-6a1a7a3a75e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:34.049599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143bc91-ccf6-49d2-b897-6a1a7a3a75e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:34.051035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143bc91-ccf6-49d2-b897-6a1a7a3a75e3 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:34.071410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 734/1470] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:43.704230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=22 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:44.069043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=66 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:53.825372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5befe3b-30d7-4c78-ae70-acc67f89a6d8 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:53.825993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5befe3b-30d7-4c78-ae70-acc67f89a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:53.825993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5befe3b-30d7-4c78-ae70-acc67f89a6d8 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:53.827407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 737/1471] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:53.833175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a02ab9-ab91-45fc-9c73-10337cd0c53d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:53.833643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a02ab9-ab91-45fc-9c73-10337cd0c53d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:53.833761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a02ab9-ab91-45fc-9c73-10337cd0c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:53.899561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-56a02ab9-ab91-45fc-9c73-10337cd0c53d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:53.901054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-56a02ab9-ab91-45fc-9c73-10337cd0c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:53.997937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 735/1472] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:54.083418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cc89-52f8-4cc6-9c4a-7da9669e3e94 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:54.083698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cc89-52f8-4cc6-9c4a-7da9669e3e94 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:54.083971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5cc89-52f8-4cc6-9c4a-7da9669e3e94 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:54.085361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 738/1473] 10.222.0.93 () {54 vars in 966 bytes} [Thu Aug 4 21:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:54.090096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066cc22-b624-4787-bfc1-10413d4d8f31 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:54.090410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066cc22-b624-4787-bfc1-10413d4d8f31 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:54.090688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066cc22-b624-4787-bfc1-10413d4d8f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:54.166542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3066cc22-b624-4787-bfc1-10413d4d8f31 None None] MFA Rules not processed for user `3ad56212b530461cb19f1bb2b4b14027`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:54.167751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3066cc22-b624-4787-bfc1-10413d4d8f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:54.188472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:54.244216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 736/1474] 10.222.0.93 () {58 vars in 1063 bytes} [Thu Aug 4 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:54.251965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5cc89-52f8-4cc6-9c4a-7da9669e3e94 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:54.253534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3ce5cc89-52f8-4cc6-9c4a-7da9669e3e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:54.358821 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5cc89-52f8-4cc6-9c4a-7da9669e3e94 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:54.432158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce5710-55de-4bd6-8469-03434f5e0d89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad56212b530461cb19f1bb2b4b14027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:54.432790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5710-55de-4bd6-8469-03434f5e0d89 service glance] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:54.433098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5710-55de-4bd6-8469-03434f5e0d89 service glance] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:54.433366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce5710-55de-4bd6-8469-03434f5e0d89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:54.435015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9bce5710-55de-4bd6-8469-03434f5e0d89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:54.490864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:54.546732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce5710-55de-4bd6-8469-03434f5e0d89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:54.548197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce5710-55de-4bd6-8469-03434f5e0d89 service glance] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:54.565987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 739/1475] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:18:56.698913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831adf6b-72ef-45ea-a00c-70fdd28d9665 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:56.699449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831adf6b-72ef-45ea-a00c-70fdd28d9665 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:56.699449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831adf6b-72ef-45ea-a00c-70fdd28d9665 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:56.700918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 737/1476] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:56.707178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc2efe-17aa-4302-9bc6-7c689ef31724 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:56.707611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc2efe-17aa-4302-9bc6-7c689ef31724 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:56.707843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc2efe-17aa-4302-9bc6-7c689ef31724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:56.779476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c0bc2efe-17aa-4302-9bc6-7c689ef31724 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:56.781392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c0bc2efe-17aa-4302-9bc6-7c689ef31724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:56.880707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 740/1477] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:18:56.904255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831adf6b-72ef-45ea-a00c-70fdd28d9665 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:56.905876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-831adf6b-72ef-45ea-a00c-70fdd28d9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:57.033849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831adf6b-72ef-45ea-a00c-70fdd28d9665 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:57.082938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:57.127790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50e3ae-3f0c-4f20-80f9-567c6f2085be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:57.128402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e3ae-3f0c-4f20-80f9-567c6f2085be admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:57.128678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e3ae-3f0c-4f20-80f9-567c6f2085be admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:57.129002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e3ae-3f0c-4f20-80f9-567c6f2085be admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:57.129752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50e3ae-3f0c-4f20-80f9-567c6f2085be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:57.131508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING py.warnings [None req-ba50e3ae-3f0c-4f20-80f9-567c6f2085be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:18:57.131508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: warnings.warn(msg) Aug 04 21:18:57.131508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: Aug 04 21:18:57.132645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50e3ae-3f0c-4f20-80f9-567c6f2085be admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:57.151899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 738/1478] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Aug 4 21:18:56 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:18:59.210851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a04f8-22ba-4f5d-920e-d7e0336951b2 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:59.211375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a04f8-22ba-4f5d-920e-d7e0336951b2 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:59.211375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a04f8-22ba-4f5d-920e-d7e0336951b2 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:59.212654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 741/1479] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:18:59.218544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee9752-4d92-48a1-aeea-711a31cf014e None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:59.218985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee9752-4d92-48a1-aeea-711a31cf014e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:59.219086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee9752-4d92-48a1-aeea-711a31cf014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:59.287651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-87ee9752-4d92-48a1-aeea-711a31cf014e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:18:59.288911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-87ee9752-4d92-48a1-aeea-711a31cf014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:59.386817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 739/1480] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:18:59.431742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a04f8-22ba-4f5d-920e-d7e0336951b2 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:18:59.433292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1f0a04f8-22ba-4f5d-920e-d7e0336951b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:59.444283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:59.584495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a04f8-22ba-4f5d-920e-d7e0336951b2 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:18:59.665502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:18:59.698954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f1f4c-0e77-48ab-b8cc-66131af3b536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:18:59.699578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1f4c-0e77-48ab-b8cc-66131af3b536 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:18:59.700045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1f4c-0e77-48ab-b8cc-66131af3b536 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:18:59.700354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1f4c-0e77-48ab-b8cc-66131af3b536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:18:59.702766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-300f1f4c-0e77-48ab-b8cc-66131af3b536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:18:59.793597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f1f4c-0e77-48ab-b8cc-66131af3b536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:18:59.795793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f1f4c-0e77-48ab-b8cc-66131af3b536 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:18:59.815101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 742/1481] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:19:02.034773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502748f-bc5e-47b6-99f8-cedf2708530f None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:02.035336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502748f-bc5e-47b6-99f8-cedf2708530f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:02.035336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502748f-bc5e-47b6-99f8-cedf2708530f None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:02.036664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 740/1482] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:19:02.041798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b8e48-fee4-4dfd-85d4-22849601318b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:02.042212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b8e48-fee4-4dfd-85d4-22849601318b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:02.042344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b8e48-fee4-4dfd-85d4-22849601318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:02.122289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9b4b8e48-fee4-4dfd-85d4-22849601318b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:19:02.124032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9b4b8e48-fee4-4dfd-85d4-22849601318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:02.170966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:02.221384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 743/1483] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:19:02.257387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502748f-bc5e-47b6-99f8-cedf2708530f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:19:02.258927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0502748f-bc5e-47b6-99f8-cedf2708530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:02.284111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:02.365420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502748f-bc5e-47b6-99f8-cedf2708530f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:19:02.439042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590254ff-e832-4b64-b3b0-18716a3bba0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:19:02.439668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590254ff-e832-4b64-b3b0-18716a3bba0d service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:02.439944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590254ff-e832-4b64-b3b0-18716a3bba0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:02.440212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590254ff-e832-4b64-b3b0-18716a3bba0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:02.441879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-590254ff-e832-4b64-b3b0-18716a3bba0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:02.518247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:02.552752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590254ff-e832-4b64-b3b0-18716a3bba0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:19:02.554221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590254ff-e832-4b64-b3b0-18716a3bba0d service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:19:02.572942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 741/1484] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:19:04.661303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102ec0-3270-4456-98bf-b95b0f9583ab None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:04.661866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102ec0-3270-4456-98bf-b95b0f9583ab None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:04.661866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102ec0-3270-4456-98bf-b95b0f9583ab None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:04.663220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 744/1485] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:19:04.668370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517548c2-3edb-4b2b-990d-f8b359c97878 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:04.668783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517548c2-3edb-4b2b-990d-f8b359c97878 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:04.669027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517548c2-3edb-4b2b-990d-f8b359c97878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:04.734845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-517548c2-3edb-4b2b-990d-f8b359c97878 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:19:04.736076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-517548c2-3edb-4b2b-990d-f8b359c97878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:04.834951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 742/1486] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:19:04.875619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102ec0-3270-4456-98bf-b95b0f9583ab None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:19:04.877303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-77102ec0-3270-4456-98bf-b95b0f9583ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:04.980616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102ec0-3270-4456-98bf-b95b0f9583ab None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:19:05.053081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:05.054806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7178-71b0-4813-8517-6e29ef1f40c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:19:05.055413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7178-71b0-4813-8517-6e29ef1f40c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:05.055694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7178-71b0-4813-8517-6e29ef1f40c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:05.055968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7178-71b0-4813-8517-6e29ef1f40c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:05.057625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b43d7178-71b0-4813-8517-6e29ef1f40c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:05.174665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7178-71b0-4813-8517-6e29ef1f40c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:19:05.176013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7178-71b0-4813-8517-6e29ef1f40c3 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:19:05.194333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 745/1487] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:19:07.318654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9d897-91d3-47ce-8a0a-76ad8f150145 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:07.319234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9d897-91d3-47ce-8a0a-76ad8f150145 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:07.319234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9d897-91d3-47ce-8a0a-76ad8f150145 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:07.320585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 743/1488] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:19:07.325845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53728f-8371-465d-a7b4-6583fbe25161 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:07.326336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53728f-8371-465d-a7b4-6583fbe25161 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:07.326610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53728f-8371-465d-a7b4-6583fbe25161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:07.393368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-bf53728f-8371-465d-a7b4-6583fbe25161 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:19:07.394575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bf53728f-8371-465d-a7b4-6583fbe25161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:07.447588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:07.491619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 746/1489] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:19:07.533097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9d897-91d3-47ce-8a0a-76ad8f150145 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:19:07.534658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8ed9d897-91d3-47ce-8a0a-76ad8f150145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:07.571422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:07.639607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9d897-91d3-47ce-8a0a-76ad8f150145 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:19:07.712383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deb363-3872-4a47-824f-52b08fd71914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:19:07.713023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deb363-3872-4a47-824f-52b08fd71914 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:07.713306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deb363-3872-4a47-824f-52b08fd71914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:07.713573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deb363-3872-4a47-824f-52b08fd71914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:07.715173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b7deb363-3872-4a47-824f-52b08fd71914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:07.796974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:07.827974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7deb363-3872-4a47-824f-52b08fd71914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:19:07.829400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7deb363-3872-4a47-824f-52b08fd71914 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:19:07.849966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 744/1490] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:19:10.278077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe5e2d-aff8-41ce-b6c6-77787785aac3 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:10.278596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe5e2d-aff8-41ce-b6c6-77787785aac3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:10.278596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe5e2d-aff8-41ce-b6c6-77787785aac3 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:10.280118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 747/1491] 10.222.0.93 () {54 vars in 927 bytes} [Thu Aug 4 21:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:19:10.285471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13ff8-952c-4280-8e07-96d9a6032177 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:10.285923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13ff8-952c-4280-8e07-96d9a6032177 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:10.286019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13ff8-952c-4280-8e07-96d9a6032177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:10.352315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9cf13ff8-952c-4280-8e07-96d9a6032177 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:19:10.353558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9cf13ff8-952c-4280-8e07-96d9a6032177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:10.451231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 745/1492] 10.222.0.93 () {58 vars in 1024 bytes} [Thu Aug 4 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:19:10.491869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe5e2d-aff8-41ce-b6c6-77787785aac3 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:19:10.493447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a4fe5e2d-aff8-41ce-b6c6-77787785aac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:10.597448 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe5e2d-aff8-41ce-b6c6-77787785aac3 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:19:10.671691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95285ff6-dd29-4481-931a-c07b24db61b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:19:10.672302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95285ff6-dd29-4481-931a-c07b24db61b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:19:10.672573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95285ff6-dd29-4481-931a-c07b24db61b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:19:10.672835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95285ff6-dd29-4481-931a-c07b24db61b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:19:10.674467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-95285ff6-dd29-4481-931a-c07b24db61b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:19:10.683376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:10.786601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95285ff6-dd29-4481-931a-c07b24db61b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:19:10.788069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95285ff6-dd29-4481-931a-c07b24db61b6 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:19:10.807259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 748/1493] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:19:20.449156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=82 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:19:20.804939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=50 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:30.946650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99854-8787-44d1-9460-34cd0b70065f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:30.947216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99854-8787-44d1-9460-34cd0b70065f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:30.947216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99854-8787-44d1-9460-34cd0b70065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:31.022559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-09e99854-8787-44d1-9460-34cd0b70065f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:20:31.024050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-09e99854-8787-44d1-9460-34cd0b70065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:31.120016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 746/1494] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:20:31.129072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd591-8dd6-4d64-b6cd-aee373100583 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:31.129631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd591-8dd6-4d64-b6cd-aee373100583 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:31.129631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd591-8dd6-4d64-b6cd-aee373100583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:31.207184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-981fd591-8dd6-4d64-b6cd-aee373100583 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:20:31.208301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-981fd591-8dd6-4d64-b6cd-aee373100583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:31.304506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 749/1495] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:20:31.309255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e99854-8787-44d1-9460-34cd0b70065f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:31.311166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-09e99854-8787-44d1-9460-34cd0b70065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:31.322699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e99854-8787-44d1-9460-34cd0b70065f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:31.383270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:31.417690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:31.418559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:31.419018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:31.419344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:31.421566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:20:31.421963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:31.423009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING py.warnings [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:20:31.423009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: warnings.warn(msg) Aug 04 21:20:31.423009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: Aug 04 21:20:31.423909 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:31.436521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 747/1496] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:20:31.444974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fd591-8dd6-4d64-b6cd-aee373100583 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:31.454412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fd591-8dd6-4d64-b6cd-aee373100583 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:31.517799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:31.551634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:31.552247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:31.552520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:31.552785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:31.553472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:31.555231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING py.warnings [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:20:31.555231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: warnings.warn(msg) Aug 04 21:20:31.555231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: Aug 04 21:20:31.556410 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:31.740818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 750/1497] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:20:31 2022] POST /identity/v3/projects => generated 379 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:20:31.745056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:31.746609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:31.781535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64fdec-b28b-4c46-b394-3c04e718eede admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:31.874213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:31.874834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:31.875110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:31.875378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:31.876042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:31.877079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING py.warnings [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:20:31.877079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: warnings.warn(msg) Aug 04 21:20:31.877079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: Aug 04 21:20:31.878319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:32.008377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 748/1498] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:20:31 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:20:32.012623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:32.014218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:32.078883 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca758-d295-41eb-a2ad-c61ce7b1bfa1 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:32.162844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:32.173026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:32.173642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:32.173916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:32.174182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:32.174861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:32.175848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING py.warnings [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:20:32.175848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: warnings.warn(msg) Aug 04 21:20:32.175848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: Aug 04 21:20:32.176725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:32.189479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 751/1499] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:20:32.193601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:32.195164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:32.207280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf224e-173d-4e76-b23c-5143e778e90f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:32.232317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:32.304836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035b0e-1aad-40db-9c3f-1e5f42b489ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:32.305483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035b0e-1aad-40db-9c3f-1e5f42b489ca admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:32.305763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035b0e-1aad-40db-9c3f-1e5f42b489ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:32.306037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035b0e-1aad-40db-9c3f-1e5f42b489ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:32.306731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035b0e-1aad-40db-9c3f-1e5f42b489ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:32.307766 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING py.warnings [None req-17035b0e-1aad-40db-9c3f-1e5f42b489ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:20:32.307766 dv-cinder-852209-1-smb devstack@keystone.service[80841]: warnings.warn(msg) Aug 04 21:20:32.307766 dv-cinder-852209-1-smb devstack@keystone.service[80841]: Aug 04 21:20:32.308656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035b0e-1aad-40db-9c3f-1e5f42b489ca admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:32.321114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 749/1500] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:20:32.325267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:32.326826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:32.361375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fed93-005b-4dd8-bb6b-055eda12a7f9 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:32.456306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef724821-4755-4dfb-bbe0-f418300f4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:32.457007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef724821-4755-4dfb-bbe0-f418300f4d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:32.457281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef724821-4755-4dfb-bbe0-f418300f4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:32.457552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef724821-4755-4dfb-bbe0-f418300f4d47 admin admin] PATH_INFO: `/v3/projects/1a5170c174594a758c3dd7fabb0fdf9d/users/1e93f57bc73d478299f5f8fb96086453/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:32.479958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef724821-4755-4dfb-bbe0-f418300f4d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5170c174594a758c3dd7fabb0fdf9d, user_id=1e93f57bc73d478299f5f8fb96086453, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:32.481014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING py.warnings [None req-ef724821-4755-4dfb-bbe0-f418300f4d47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:20:32.481014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: warnings.warn(msg) Aug 04 21:20:32.481014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: Aug 04 21:20:32.482953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef724821-4755-4dfb-bbe0-f418300f4d47 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:32.613959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 752/1501] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:20:32 2022] PUT /identity/v3/projects/1a5170c174594a758c3dd7fabb0fdf9d/users/1e93f57bc73d478299f5f8fb96086453/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:20:32.626717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acbda2-82e7-40ce-8814-df6cf301a449 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:32.626999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acbda2-82e7-40ce-8814-df6cf301a449 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:32.627274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acbda2-82e7-40ce-8814-df6cf301a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:32.685094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-56acbda2-82e7-40ce-8814-df6cf301a449 None None] MFA Rules not processed for user `1e93f57bc73d478299f5f8fb96086453`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:20:32.686366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-56acbda2-82e7-40ce-8814-df6cf301a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:32.763707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 750/1502] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:20:32.778215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b13a-4a43-4937-a95c-e8642b152b25 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:32.778516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b13a-4a43-4937-a95c-e8642b152b25 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:32.778769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b13a-4a43-4937-a95c-e8642b152b25 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:32.780705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 753/1503] 10.222.0.93 () {54 vars in 964 bytes} [Thu Aug 4 21:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:20:32.785810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f9cf-ac1f-4b58-a14f-dc01c42db207 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:32.786104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f9cf-ac1f-4b58-a14f-dc01c42db207 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:32.792264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f9cf-ac1f-4b58-a14f-dc01c42db207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:32.819152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:32.865588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3337f9cf-ac1f-4b58-a14f-dc01c42db207 None None] MFA Rules not processed for user `3771fe71ef624fd38dcaf2bff3751663`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:20:32.866765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3337f9cf-ac1f-4b58-a14f-dc01c42db207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:32.950413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 751/1504] 10.222.0.93 () {58 vars in 1061 bytes} [Thu Aug 4 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:20:32.959279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33b13a-4a43-4937-a95c-e8642b152b25 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:32.960784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7e33b13a-4a43-4937-a95c-e8642b152b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:33.012811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:33.068966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33b13a-4a43-4937-a95c-e8642b152b25 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:33.147402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:33.148093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:33.148381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:33.148947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:33.150606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:33.253779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:33.255250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:33.258777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:33.274242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 754/1505] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:20:33.320600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75f6d-b5f0-455e-9f2e-4828a45a48a0 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:33.321048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75f6d-b5f0-455e-9f2e-4828a45a48a0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:33.321179 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75f6d-b5f0-455e-9f2e-4828a45a48a0 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:33.322478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 752/1506] 10.222.0.93 () {52 vars in 830 bytes} [Thu Aug 4 21:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:20:33.325969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:33.327631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:33.425676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9a575-dfb4-4888-82a3-3f983e6a8e1e service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:33.520540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:33.521221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:33.521478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:33.521743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] PATH_INFO: `/v3/users/1e93f57bc73d478299f5f8fb96086453` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:33.534704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e93f57bc73d478299f5f8fb96086453)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:33.535715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING py.warnings [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:20:33.535715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: warnings.warn(msg) Aug 04 21:20:33.535715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: Aug 04 21:20:33.536944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:33.547367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:33.755221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e93f57bc73d478299f5f8fb96086453'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:33.755573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e93f57bc73d478299f5f8fb96086453'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:33.756095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e93f57bc73d478299f5f8fb96086453'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:33.781490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e93f57bc73d478299f5f8fb96086453'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:33.909895 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e93f57bc73d478299f5f8fb96086453'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:33.932505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 755/1507] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:20:33 2022] DELETE /identity/v3/users/1e93f57bc73d478299f5f8fb96086453 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:20:33.938921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693c55-fc10-4731-ae54-6c6da27ce7be None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:33.939358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693c55-fc10-4731-ae54-6c6da27ce7be None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:33.939723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693c55-fc10-4731-ae54-6c6da27ce7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:33.996588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-49693c55-fc10-4731-ae54-6c6da27ce7be None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:20:33.997871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-49693c55-fc10-4731-ae54-6c6da27ce7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:34.073866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:34.087774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 753/1508] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:20:34.097691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:34.098957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:34.200484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc564b-aa51-4156-b7cc-53c8d5da732d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:34.256068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:34.275540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f6bbf-4245-4b36-828c-05f9b0bd5889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:34.276159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f6bbf-4245-4b36-828c-05f9b0bd5889 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:34.276431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f6bbf-4245-4b36-828c-05f9b0bd5889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:34.276696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f6bbf-4245-4b36-828c-05f9b0bd5889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:34.278339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b17f6bbf-4245-4b36-828c-05f9b0bd5889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:34.392113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f6bbf-4245-4b36-828c-05f9b0bd5889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:34.393589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f6bbf-4245-4b36-828c-05f9b0bd5889 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:34.412772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 756/1509] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:20:34.958605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49693c55-fc10-4731-ae54-6c6da27ce7be None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:20:34.959832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-49693c55-fc10-4731-ae54-6c6da27ce7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:20:34.972144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49693c55-fc10-4731-ae54-6c6da27ce7be None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:20:35.070960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:20:35.071603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:20:35.071882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:20:35.072156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] PATH_INFO: `/v3/projects/1a5170c174594a758c3dd7fabb0fdf9d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:20:35.082604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a5170c174594a758c3dd7fabb0fdf9d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:20:35.083632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING py.warnings [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:20:35.083632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: warnings.warn(msg) Aug 04 21:20:35.083632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: Aug 04 21:20:35.084861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:20:35.245932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a5170c174594a758c3dd7fabb0fdf9d', 'request_id': 'req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:35.252619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a5170c174594a758c3dd7fabb0fdf9d', 'request_id': 'req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:35.349648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a5170c174594a758c3dd7fabb0fdf9d', 'request_id': 'req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:35.382122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] The token cache is being invalidate because project 1a5170c174594a758c3dd7fabb0fdf9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:20:35.382403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:35.382827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-75603c9f-bfb2-470d-af0e-4239cb0e5f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:20:35.384218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 754/1510] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:20:34 2022] DELETE /identity/v3/projects/1a5170c174594a758c3dd7fabb0fdf9d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:20:44.410524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=62 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:20:45.380093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:22:18.398605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0871a-6964-4117-8b6b-7c20bf148efa None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:18.399210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0871a-6964-4117-8b6b-7c20bf148efa None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:18.399210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0871a-6964-4117-8b6b-7c20bf148efa None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:18.400535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:22:18.405757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7d703-8ffa-49f8-a0ba-b616b3d8d7c7 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:18.406237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7d703-8ffa-49f8-a0ba-b616b3d8d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:18.406340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7d703-8ffa-49f8-a0ba-b616b3d8d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:18.490015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f8c7d703-8ffa-49f8-a0ba-b616b3d8d7c7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:18.491253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f8c7d703-8ffa-49f8-a0ba-b616b3d8d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:18.598090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:22:18.756586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0871a-6964-4117-8b6b-7c20bf148efa None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:18.758756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b2a0871a-6964-4117-8b6b-7c20bf148efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:18.880380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0871a-6964-4117-8b6b-7c20bf148efa None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:18.885875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253a1bc-7b9d-45a5-90e4-391c050efffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:18.886998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a1bc-7b9d-45a5-90e4-391c050efffc service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:18.887275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a1bc-7b9d-45a5-90e4-391c050efffc service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:18.887548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253a1bc-7b9d-45a5-90e4-391c050efffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:18.895617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253a1bc-7b9d-45a5-90e4-391c050efffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:18.897503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253a1bc-7b9d-45a5-90e4-391c050efffc service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:18.907360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 758/1513] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:22:19.746783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b5db-092c-466b-8eec-974f8df7398c None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:19.747330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b5db-092c-466b-8eec-974f8df7398c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:19.747448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b5db-092c-466b-8eec-974f8df7398c None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:19.748791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:22:19.753635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd61c4-249e-462f-85be-006081c29ff0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:19.754081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd61c4-249e-462f-85be-006081c29ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:19.754185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd61c4-249e-462f-85be-006081c29ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:19.774300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-36fd61c4-249e-462f-85be-006081c29ff0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:19.778155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-36fd61c4-249e-462f-85be-006081c29ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:19.784627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:22:19.944025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20b5db-092c-466b-8eec-974f8df7398c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:19.958753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20b5db-092c-466b-8eec-974f8df7398c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:19.963975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d32207-0a6f-4529-8240-1f5899d5976e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:19.964607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32207-0a6f-4529-8240-1f5899d5976e service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:19.964905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32207-0a6f-4529-8240-1f5899d5976e service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:19.965261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32207-0a6f-4529-8240-1f5899d5976e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:19.973604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d32207-0a6f-4529-8240-1f5899d5976e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:19.975170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d32207-0a6f-4529-8240-1f5899d5976e service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:19.985986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 757/1516] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:22:21.188551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f3dfa-9c97-4122-a42e-bb81e8ac486e None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:21.189174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f3dfa-9c97-4122-a42e-bb81e8ac486e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:21.189174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f3dfa-9c97-4122-a42e-bb81e8ac486e None None] PATH_INFO: `/v3` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:21.190436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 760/1517] 10.222.0.78 () {54 vars in 925 bytes} [Thu Aug 4 21:22:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:22:21.198596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537a1a-08da-4e4f-8702-5f1695b0570b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:21.199005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537a1a-08da-4e4f-8702-5f1695b0570b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:21.199152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8537a1a-08da-4e4f-8702-5f1695b0570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:21.259828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f8537a1a-08da-4e4f-8702-5f1695b0570b None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:21.261084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f8537a1a-08da-4e4f-8702-5f1695b0570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:21.278100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:22:21.333962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 758/1518] 10.222.0.78 () {58 vars in 1015 bytes} [Thu Aug 4 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:22:25.635175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d16d4-4533-4395-99e5-47072daec079 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:25.635712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d16d4-4533-4395-99e5-47072daec079 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:25.635712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d16d4-4533-4395-99e5-47072daec079 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:25.637635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 761/1519] 10.222.0.93 () {54 vars in 961 bytes} [Thu Aug 4 21:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:22:25.642775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681e16-9104-4415-9c9b-ad3702b70aa5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:25.643209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681e16-9104-4415-9c9b-ad3702b70aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:25.643319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681e16-9104-4415-9c9b-ad3702b70aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:25.663123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-56681e16-9104-4415-9c9b-ad3702b70aa5 None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:25.664337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-56681e16-9104-4415-9c9b-ad3702b70aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:25.674889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 759/1520] 10.222.0.93 () {58 vars in 1058 bytes} [Thu Aug 4 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:22:25.682447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d16d4-4533-4395-99e5-47072daec079 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:25.697221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d16d4-4533-4395-99e5-47072daec079 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:25.702801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829829b9-5456-4dbf-8d89-722a0340c739 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:25.703406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829829b9-5456-4dbf-8d89-722a0340c739 service placement] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:25.703684 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829829b9-5456-4dbf-8d89-722a0340c739 service placement] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:25.703955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829829b9-5456-4dbf-8d89-722a0340c739 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:25.712347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829829b9-5456-4dbf-8d89-722a0340c739 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:25.713940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829829b9-5456-4dbf-8d89-722a0340c739 service placement] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:25.725442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 762/1521] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:22:31.217113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b17ab-e3ac-43e5-ba18-968f9deca734 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:31.217729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b17ab-e3ac-43e5-ba18-968f9deca734 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:31.217729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b17ab-e3ac-43e5-ba18-968f9deca734 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:31.219027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:22:31.224016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321ec8-06fd-417a-974d-36e7103fa9ca None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:31.224495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321ec8-06fd-417a-974d-36e7103fa9ca None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:31.224602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321ec8-06fd-417a-974d-36e7103fa9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:31.244749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-83321ec8-06fd-417a-974d-36e7103fa9ca None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:31.246748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-83321ec8-06fd-417a-974d-36e7103fa9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:31.254665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:22:31.409864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b17ab-e3ac-43e5-ba18-968f9deca734 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:31.424903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b17ab-e3ac-43e5-ba18-968f9deca734 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:31.430358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b5581-7cdb-4bd3-bad0-dae85f0a661e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:31.430958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5581-7cdb-4bd3-bad0-dae85f0a661e service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:31.431236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5581-7cdb-4bd3-bad0-dae85f0a661e service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:31.431508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b5581-7cdb-4bd3-bad0-dae85f0a661e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:31.440712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b5581-7cdb-4bd3-bad0-dae85f0a661e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:31.442316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b5581-7cdb-4bd3-bad0-dae85f0a661e service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:31.452643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 761/1524] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:22:32.287726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfd03-7f73-4a80-8e08-b6e823a1a717 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:32.288315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfd03-7f73-4a80-8e08-b6e823a1a717 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:32.288315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdfd03-7f73-4a80-8e08-b6e823a1a717 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:32.289688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 21:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:22:32.294979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc48b-a303-47a4-9903-818fc0b4033d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:32.295404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc48b-a303-47a4-9903-818fc0b4033d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:32.295505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc48b-a303-47a4-9903-818fc0b4033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:32.315150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-08fcc48b-a303-47a4-9903-818fc0b4033d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:32.316354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-08fcc48b-a303-47a4-9903-818fc0b4033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:32.325158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 21:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:22:32.476125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdfd03-7f73-4a80-8e08-b6e823a1a717 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:32.490714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdfd03-7f73-4a80-8e08-b6e823a1a717 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:32.496287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67e79b-40c8-4006-a6df-c0d7cb739f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:32.496989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e79b-40c8-4006-a6df-c0d7cb739f32 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:32.497262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e79b-40c8-4006-a6df-c0d7cb739f32 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:32.497533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e79b-40c8-4006-a6df-c0d7cb739f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:32.506191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67e79b-40c8-4006-a6df-c0d7cb739f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:32.507770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67e79b-40c8-4006-a6df-c0d7cb739f32 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:32.517712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 765/1527] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:22:36.991430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e82347-201b-48bc-9cbd-ca4566a3eaa7 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:36.991961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e82347-201b-48bc-9cbd-ca4566a3eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:36.991961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e82347-201b-48bc-9cbd-ca4566a3eaa7 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:36.993282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:22:36.999492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586248e-ba2d-4194-82b5-625913381669 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:36.999957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586248e-ba2d-4194-82b5-625913381669 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:37.000063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586248e-ba2d-4194-82b5-625913381669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:37.018989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4586248e-ba2d-4194-82b5-625913381669 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:37.020217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4586248e-ba2d-4194-82b5-625913381669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:37.028917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:22:37.103832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e82347-201b-48bc-9cbd-ca4566a3eaa7 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:37.106232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-05e82347-201b-48bc-9cbd-ca4566a3eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:37.188410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e82347-201b-48bc-9cbd-ca4566a3eaa7 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:37.191976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d3e98-b9eb-44f1-ac97-db51a941244b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:37.192590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3e98-b9eb-44f1-ac97-db51a941244b service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:37.192867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3e98-b9eb-44f1-ac97-db51a941244b service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:37.193164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3e98-b9eb-44f1-ac97-db51a941244b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:37.202202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d3e98-b9eb-44f1-ac97-db51a941244b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:37.203671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d3e98-b9eb-44f1-ac97-db51a941244b service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:37.213119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 764/1530] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:22:39.226704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddac5b-a16b-4dc3-8cc9-59fff1d0601c None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:39.227279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddac5b-a16b-4dc3-8cc9-59fff1d0601c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:39.227279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddac5b-a16b-4dc3-8cc9-59fff1d0601c None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:39.228599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:22:39.234542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5c2f-c87e-4f9f-a9b9-ee462e1d1d35 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:39.235001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5c2f-c87e-4f9f-a9b9-ee462e1d1d35 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:39.235106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5c2f-c87e-4f9f-a9b9-ee462e1d1d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:39.254924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d41c5c2f-c87e-4f9f-a9b9-ee462e1d1d35 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:39.256188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d41c5c2f-c87e-4f9f-a9b9-ee462e1d1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:39.264481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:22:39.301433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddac5b-a16b-4dc3-8cc9-59fff1d0601c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:39.312864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddac5b-a16b-4dc3-8cc9-59fff1d0601c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:39.316336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04951852-1977-4bf5-8f03-6583a83dd215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:39.316956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04951852-1977-4bf5-8f03-6583a83dd215 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:39.317234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04951852-1977-4bf5-8f03-6583a83dd215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:39.317504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04951852-1977-4bf5-8f03-6583a83dd215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:39.326673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04951852-1977-4bf5-8f03-6583a83dd215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:39.328086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04951852-1977-4bf5-8f03-6583a83dd215 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:39.337356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 768/1533] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:22:43.462912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e43274-4a69-4c49-8d22-2eab1073af05 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:43.463515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e43274-4a69-4c49-8d22-2eab1073af05 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:43.463515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e43274-4a69-4c49-8d22-2eab1073af05 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:43.464902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:22:43.470408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc1e74-020d-4506-ac29-298eddf44f54 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:43.470824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc1e74-020d-4506-ac29-298eddf44f54 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:43.470956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc1e74-020d-4506-ac29-298eddf44f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:43.490116 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-d7dc1e74-020d-4506-ac29-298eddf44f54 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:43.491451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d7dc1e74-020d-4506-ac29-298eddf44f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:43.500204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:22:43.811236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e43274-4a69-4c49-8d22-2eab1073af05 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:43.812968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a3e43274-4a69-4c49-8d22-2eab1073af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:43.883740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:22:43.898983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e43274-4a69-4c49-8d22-2eab1073af05 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:43.902797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d8f09-6d01-42ca-be05-182301abe85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:43.903417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d8f09-6d01-42ca-be05-182301abe85c service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:43.903698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d8f09-6d01-42ca-be05-182301abe85c service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:43.903974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d8f09-6d01-42ca-be05-182301abe85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:43.913332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d8f09-6d01-42ca-be05-182301abe85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:43.914792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d8f09-6d01-42ca-be05-182301abe85c service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:43.924933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 767/1536] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:22:45.998195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e074-6673-4b52-be52-95a13e129314 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:45.998770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e074-6673-4b52-be52-95a13e129314 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:45.998770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e074-6673-4b52-be52-95a13e129314 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:46.000068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 21:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:22:46.005344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc2df-564c-461f-a621-8465371282a6 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:46.005775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc2df-564c-461f-a621-8465371282a6 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:46.005918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc2df-564c-461f-a621-8465371282a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:46.026087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9ccdc2df-564c-461f-a621-8465371282a6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:22:46.027508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9ccdc2df-564c-461f-a621-8465371282a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:46.035343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:22:46.337502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e074-6673-4b52-be52-95a13e129314 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:22:46.339284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-32e1e074-6673-4b52-be52-95a13e129314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:22:46.346972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=84 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:22:46.352712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e074-6673-4b52-be52-95a13e129314 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:22:46.356171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38fde9-3337-41ae-8e80-59df68fe30db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:22:46.356764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38fde9-3337-41ae-8e80-59df68fe30db service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:22:46.357063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38fde9-3337-41ae-8e80-59df68fe30db service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:22:46.362019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38fde9-3337-41ae-8e80-59df68fe30db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:22:46.366218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38fde9-3337-41ae-8e80-59df68fe30db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:22:46.367616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38fde9-3337-41ae-8e80-59df68fe30db service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:22:46.377347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 771/1539] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:22:56.021064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=11 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:22:56.387983 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:17.652207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d0d4-6f56-47e6-ab35-eb90206c86df None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:17.654330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d0d4-6f56-47e6-ab35-eb90206c86df None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:17.654857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d0d4-6f56-47e6-ab35-eb90206c86df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:17.686510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b317d0d4-6f56-47e6-ab35-eb90206c86df None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:17.688131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b317d0d4-6f56-47e6-ab35-eb90206c86df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:17.696908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 769/1540] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:17.706321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c610e-5a75-4618-a128-d891a8610378 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:17.707409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c610e-5a75-4618-a128-d891a8610378 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:17.707924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c610e-5a75-4618-a128-d891a8610378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:17.738574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e50c610e-5a75-4618-a128-d891a8610378 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:17.739836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e50c610e-5a75-4618-a128-d891a8610378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:17.753282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 772/1541] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:17.759696 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317d0d4-6f56-47e6-ab35-eb90206c86df None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:17.771678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317d0d4-6f56-47e6-ab35-eb90206c86df None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:17.777183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:17.778075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:17.778371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:17.779165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:17.779884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:17.780187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:17.782003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:17.799340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 770/1542] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:17.807459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c610e-5a75-4618-a128-d891a8610378 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:17.818243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c610e-5a75-4618-a128-d891a8610378 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:17.829681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73463d83-9824-451c-b6c6-0e1e897f944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:17.830324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73463d83-9824-451c-b6c6-0e1e897f944e admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:17.830604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73463d83-9824-451c-b6c6-0e1e897f944e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:17.830877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73463d83-9824-451c-b6c6-0e1e897f944e admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:17.831833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73463d83-9824-451c-b6c6-0e1e897f944e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:17.834095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73463d83-9824-451c-b6c6-0e1e897f944e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:17.978635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 773/1543] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:17 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:17.983576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:17.998698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b517a-84c2-494a-960c-faea7dbc4a4d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.072373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79b406-5a85-4def-9ef1-82eb76b82578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.073031 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b406-5a85-4def-9ef1-82eb76b82578 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.073317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b406-5a85-4def-9ef1-82eb76b82578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.073594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b406-5a85-4def-9ef1-82eb76b82578 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.074277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79b406-5a85-4def-9ef1-82eb76b82578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.076792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79b406-5a85-4def-9ef1-82eb76b82578 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.104624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd287bc-75e4-4eb8-9c07-61abc850f9ff None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.104993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd287bc-75e4-4eb8-9c07-61abc850f9ff None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.105196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd287bc-75e4-4eb8-9c07-61abc850f9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.127408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3bd287bc-75e4-4eb8-9c07-61abc850f9ff None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.129309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3bd287bc-75e4-4eb8-9c07-61abc850f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.140293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 774/1544] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:18.150818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba582f-5caf-4c4b-81b8-5607fa7ecfcf None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.151114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba582f-5caf-4c4b-81b8-5607fa7ecfcf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.151516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba582f-5caf-4c4b-81b8-5607fa7ecfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.179730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-afba582f-5caf-4c4b-81b8-5607fa7ecfcf None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.181475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-afba582f-5caf-4c4b-81b8-5607fa7ecfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.193113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 775/1545] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:18.194285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90bcc-71be-470d-bc7b-ed2654c95224 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.194624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90bcc-71be-470d-bc7b-ed2654c95224 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.194893 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90bcc-71be-470d-bc7b-ed2654c95224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.212091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 771/1546] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:17 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:18.212870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79b406-5a85-4def-9ef1-82eb76b82578 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.227373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9ee90bcc-71be-470d-bc7b-ed2654c95224 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.228551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9ee90bcc-71be-470d-bc7b-ed2654c95224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.234332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79b406-5a85-4def-9ef1-82eb76b82578 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.245054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac6c2d-188a-4e0a-9e63-d9a3f5a8ad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.245248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 776/1547] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.245702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6c2d-188a-4e0a-9e63-d9a3f5a8ad45 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.245896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee90bcc-71be-470d-bc7b-ed2654c95224 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.246021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6c2d-188a-4e0a-9e63-d9a3f5a8ad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.246392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac6c2d-188a-4e0a-9e63-d9a3f5a8ad45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.247105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac6c2d-188a-4e0a-9e63-d9a3f5a8ad45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:18.247966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac6c2d-188a-4e0a-9e63-d9a3f5a8ad45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.249704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac6c2d-188a-4e0a-9e63-d9a3f5a8ad45 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.262846 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee90bcc-71be-470d-bc7b-ed2654c95224 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.276276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 772/1548] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:18.277536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166712-b11a-4800-932e-f6fc96fa2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.277797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57c60a-1ec0-45e4-a80e-2e8170dfe174 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.278024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57c60a-1ec0-45e4-a80e-2e8170dfe174 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.278149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166712-b11a-4800-932e-f6fc96fa2e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.278319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57c60a-1ec0-45e4-a80e-2e8170dfe174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.278425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166712-b11a-4800-932e-f6fc96fa2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.278709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166712-b11a-4800-932e-f6fc96fa2e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.279401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53166712-b11a-4800-932e-f6fc96fa2e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.281267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53166712-b11a-4800-932e-f6fc96fa2e16 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.302054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 777/1549] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:18.303320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166712-b11a-4800-932e-f6fc96fa2e16 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.321433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1d57c60a-1ec0-45e4-a80e-2e8170dfe174 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.322738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1d57c60a-1ec0-45e4-a80e-2e8170dfe174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.322872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166712-b11a-4800-932e-f6fc96fa2e16 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.342070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 773/1550] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.343491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57c60a-1ec0-45e4-a80e-2e8170dfe174 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.349200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8a556-50b6-416e-a4cf-927ebf67a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.349841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8a556-50b6-416e-a4cf-927ebf67a47d admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.350120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8a556-50b6-416e-a4cf-927ebf67a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.350393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8a556-50b6-416e-a4cf-927ebf67a47d admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.351057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8a556-50b6-416e-a4cf-927ebf67a47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.354089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8a556-50b6-416e-a4cf-927ebf67a47d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.367396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57c60a-1ec0-45e4-a80e-2e8170dfe174 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.380993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9286c4-c21b-47bc-af67-28904a9739a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.383546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9286c4-c21b-47bc-af67-28904a9739a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.383546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9286c4-c21b-47bc-af67-28904a9739a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.383546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9286c4-c21b-47bc-af67-28904a9739a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.383546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9286c4-c21b-47bc-af67-28904a9739a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.385208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9286c4-c21b-47bc-af67-28904a9739a2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.397837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 774/1551] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:18.399025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4746c-8313-4433-849d-7c7a4c3b38f5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.399875 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4746c-8313-4433-849d-7c7a4c3b38f5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.400214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4746c-8313-4433-849d-7c7a4c3b38f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.420123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-38b4746c-8313-4433-849d-7c7a4c3b38f5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.421372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-38b4746c-8313-4433-849d-7c7a4c3b38f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.429549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 775/1552] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.430422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4746c-8313-4433-849d-7c7a4c3b38f5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.440533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4746c-8313-4433-849d-7c7a4c3b38f5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.445270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fa17e-2fe8-4bdc-8c58-3fd7013215cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.445879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fa17e-2fe8-4bdc-8c58-3fd7013215cd admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.446161 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fa17e-2fe8-4bdc-8c58-3fd7013215cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.446436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fa17e-2fe8-4bdc-8c58-3fd7013215cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.447151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fa17e-2fe8-4bdc-8c58-3fd7013215cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:18.447439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fa17e-2fe8-4bdc-8c58-3fd7013215cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.449065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fa17e-2fe8-4bdc-8c58-3fd7013215cd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.461145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 776/1553] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:18.462320 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6cb5-0d71-4e0a-91ef-b8dc84f0a970 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.462605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6cb5-0d71-4e0a-91ef-b8dc84f0a970 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.462884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6cb5-0d71-4e0a-91ef-b8dc84f0a970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.484958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-8cfa6cb5-0d71-4e0a-91ef-b8dc84f0a970 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.485626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8cfa6cb5-0d71-4e0a-91ef-b8dc84f0a970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.493778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 777/1554] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.495049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e0fc-cf83-4169-b5ad-167a64b73890 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.495335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e0fc-cf83-4169-b5ad-167a64b73890 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.495609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e0fc-cf83-4169-b5ad-167a64b73890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.510010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 778/1555] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/projects => generated 389 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:18.512070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe39244-d723-4fd9-8d51-45c8fd1290d1 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.512070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe39244-d723-4fd9-8d51-45c8fd1290d1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.512070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe39244-d723-4fd9-8d51-45c8fd1290d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.520963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9931e0fc-cf83-4169-b5ad-167a64b73890 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.522489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9931e0fc-cf83-4169-b5ad-167a64b73890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.532564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-fbe39244-d723-4fd9-8d51-45c8fd1290d1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.533843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fbe39244-d723-4fd9-8d51-45c8fd1290d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.590219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 778/1556] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.590219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931e0fc-cf83-4169-b5ad-167a64b73890 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.595990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931e0fc-cf83-4169-b5ad-167a64b73890 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.598221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 779/1557] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.598443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2f743-e657-42ba-93be-8b1ce3582bd4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.598733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2f743-e657-42ba-93be-8b1ce3582bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.599007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2f743-e657-42ba-93be-8b1ce3582bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.600994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c991e2-7735-4c46-afab-d559706eb0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.601676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c991e2-7735-4c46-afab-d559706eb0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.602098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c991e2-7735-4c46-afab-d559706eb0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.602387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c991e2-7735-4c46-afab-d559706eb0c0 admin admin] PATH_INFO: `/v3/projects/0d0c5e43053343cda8cd2a4a0f94c7d8/users/8a8974607c724b8a8b273502379a52a9/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.616623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:18.619506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b1a2f743-e657-42ba-93be-8b1ce3582bd4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.620601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c991e2-7735-4c46-afab-d559706eb0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c5e43053343cda8cd2a4a0f94c7d8, user_id=8a8974607c724b8a8b273502379a52a9, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.620774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b1a2f743-e657-42ba-93be-8b1ce3582bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.621718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING py.warnings [None req-91c991e2-7735-4c46-afab-d559706eb0c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:24:18.621718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: warnings.warn(msg) Aug 04 21:24:18.621718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: Aug 04 21:24:18.626900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c991e2-7735-4c46-afab-d559706eb0c0 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.629517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 780/1558] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.630738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd16ad-9ec9-4a59-b2c3-c4691c7e5027 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.631021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd16ad-9ec9-4a59-b2c3-c4691c7e5027 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.631294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd16ad-9ec9-4a59-b2c3-c4691c7e5027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.650328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-84dd16ad-9ec9-4a59-b2c3-c4691c7e5027 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.651521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-84dd16ad-9ec9-4a59-b2c3-c4691c7e5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.660047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 781/1559] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.663749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd16ad-9ec9-4a59-b2c3-c4691c7e5027 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.671209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd16ad-9ec9-4a59-b2c3-c4691c7e5027 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.675735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300ee2e-8e9e-4d6f-953b-3f22ea4edbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.676317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300ee2e-8e9e-4d6f-953b-3f22ea4edbda admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.676594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300ee2e-8e9e-4d6f-953b-3f22ea4edbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.676861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300ee2e-8e9e-4d6f-953b-3f22ea4edbda admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.677540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300ee2e-8e9e-4d6f-953b-3f22ea4edbda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.679417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300ee2e-8e9e-4d6f-953b-3f22ea4edbda admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.698116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 779/1560] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:18 2022] PUT /identity/v3/projects/0d0c5e43053343cda8cd2a4a0f94c7d8/users/8a8974607c724b8a8b273502379a52a9/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:18.701942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf324b-6480-44f3-9ef2-4be992fa42ca None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.701942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf324b-6480-44f3-9ef2-4be992fa42ca None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.701942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf324b-6480-44f3-9ef2-4be992fa42ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.719537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-62bf324b-6480-44f3-9ef2-4be992fa42ca None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.724990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-62bf324b-6480-44f3-9ef2-4be992fa42ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.782594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 780/1561] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.783413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf324b-6480-44f3-9ef2-4be992fa42ca None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.792943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf324b-6480-44f3-9ef2-4be992fa42ca None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.797597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 782/1562] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:18.805230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923055-397f-4520-8201-388ead905f8a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.805230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923055-397f-4520-8201-388ead905f8a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.805230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923055-397f-4520-8201-388ead905f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.805532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad6464-663e-4fe4-bd47-269b3f9a0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.805532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad6464-663e-4fe4-bd47-269b3f9a0333 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.805532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad6464-663e-4fe4-bd47-269b3f9a0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.805532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad6464-663e-4fe4-bd47-269b3f9a0333 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.805913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad6464-663e-4fe4-bd47-269b3f9a0333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.805913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad6464-663e-4fe4-bd47-269b3f9a0333 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.820052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-bd923055-397f-4520-8201-388ead905f8a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.821299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bd923055-397f-4520-8201-388ead905f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.852561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:18.880672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 783/1563] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.885053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 781/1564] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:18.885188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30774f88-1aa9-4382-9260-8bd6e65bb05e None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.885188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30774f88-1aa9-4382-9260-8bd6e65bb05e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.885188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30774f88-1aa9-4382-9260-8bd6e65bb05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.885447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a262d-ae45-4b2f-b035-46e0f67ae5d5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.885447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a262d-ae45-4b2f-b035-46e0f67ae5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.885447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a262d-ae45-4b2f-b035-46e0f67ae5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.903631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-30774f88-1aa9-4382-9260-8bd6e65bb05e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.905688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-5a9a262d-ae45-4b2f-b035-46e0f67ae5d5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.905999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-30774f88-1aa9-4382-9260-8bd6e65bb05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.906840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5a9a262d-ae45-4b2f-b035-46e0f67ae5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.914349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 784/1565] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.914813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 782/1566] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.915964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bf389-b17a-4fbe-9813-5e65de7db16b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.916251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bf389-b17a-4fbe-9813-5e65de7db16b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.916528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bf389-b17a-4fbe-9813-5e65de7db16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.917599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30774f88-1aa9-4382-9260-8bd6e65bb05e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.928665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30774f88-1aa9-4382-9260-8bd6e65bb05e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.933594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.934195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.934466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.934790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.935437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:18.935838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.936493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d47bf389-b17a-4fbe-9813-5e65de7db16b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:18.936845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING py.warnings [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:24:18.936845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: warnings.warn(msg) Aug 04 21:24:18.936845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: Aug 04 21:24:18.937752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d47bf389-b17a-4fbe-9813-5e65de7db16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:18.937876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.945360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 783/1567] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:18.946132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bf389-b17a-4fbe-9813-5e65de7db16b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.955335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 785/1568] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:18.956381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.956746 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bf389-b17a-4fbe-9813-5e65de7db16b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.965883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.967508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.967508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.967740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.968350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:18.968649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.970481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.973041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d0df-eeb0-40f9-9135-eeee29ecf683 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:18.977520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:18.978150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:18.978427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:18.978702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:18.979729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:18.980380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING py.warnings [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:24:18.980380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: warnings.warn(msg) Aug 04 21:24:18.980380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: Aug 04 21:24:18.981685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:18.983510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 784/1569] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:18.984439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:18.997391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20735e4-173a-46be-b8f3-2b72bb082409 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.004227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.004829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.005133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.005401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.006078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:19.006377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.008128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.021169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 785/1570] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:19.022283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.036086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f651f-85b0-45e6-86e8-399442166082 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.038411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e456aeb-39a6-426d-8023-ed1c28eb82ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.039040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456aeb-39a6-426d-8023-ed1c28eb82ca admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.039323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456aeb-39a6-426d-8023-ed1c28eb82ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.039597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456aeb-39a6-426d-8023-ed1c28eb82ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.040316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e456aeb-39a6-426d-8023-ed1c28eb82ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.043869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e456aeb-39a6-426d-8023-ed1c28eb82ca admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.054210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 786/1571] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:19.054210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e456aeb-39a6-426d-8023-ed1c28eb82ca admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.064735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e456aeb-39a6-426d-8023-ed1c28eb82ca admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.069502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.070124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.070411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.070683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.071369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:19.071672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.073329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.087134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 786/1572] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:18 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:19.088034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.097603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 787/1573] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:19.097603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.100508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59245917-8429-457b-8b43-53839e75bbbc admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.105883 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.106447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.107386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.107640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.108209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:19.108508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.110281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.124037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 787/1574] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:19.124037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.135605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf87b4c-b0a6-4294-9346-a8bf5a02f0b2 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.141102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd7d3e-a146-4320-9c5f-7d7da3915120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.141708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd7d3e-a146-4320-9c5f-7d7da3915120 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.141989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd7d3e-a146-4320-9c5f-7d7da3915120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.142262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd7d3e-a146-4320-9c5f-7d7da3915120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.142948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd7d3e-a146-4320-9c5f-7d7da3915120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.144867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd7d3e-a146-4320-9c5f-7d7da3915120 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.175766 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12cc59-7e59-4f78-be58-7f47e6ce2661 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.181786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9cb99-8976-41e4-a85f-4da44f1694d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.182885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9cb99-8976-41e4-a85f-4da44f1694d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.183427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9cb99-8976-41e4-a85f-4da44f1694d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.183910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9cb99-8976-41e4-a85f-4da44f1694d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.200683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9cb99-8976-41e4-a85f-4da44f1694d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.203599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9cb99-8976-41e4-a85f-4da44f1694d4 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.220480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 788/1575] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:19.221982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9cb99-8976-41e4-a85f-4da44f1694d4 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.238007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 788/1576] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:19 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:19.238862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9cb99-8976-41e4-a85f-4da44f1694d4 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.239242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd7d3e-a146-4320-9c5f-7d7da3915120 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.253254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:19.308184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd7d3e-a146-4320-9c5f-7d7da3915120 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.311864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.312533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.312815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.313123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.313646 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f598-8716-454a-822a-08f465e1ac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.313780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.314464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f598-8716-454a-822a-08f465e1ac6b admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.314748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f598-8716-454a-822a-08f465e1ac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.314975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING py.warnings [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:24:19.314975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: warnings.warn(msg) Aug 04 21:24:19.314975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: Aug 04 21:24:19.315220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f598-8716-454a-822a-08f465e1ac6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.315868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4f598-8716-454a-822a-08f465e1ac6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.316213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.318028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4f598-8716-454a-822a-08f465e1ac6b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.435551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 789/1577] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:19 2022] POST /identity/v3/projects => generated 405 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:19.436321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 789/1578] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:19 2022] POST /identity/v3/projects => generated 355 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:19.437001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f598-8716-454a-822a-08f465e1ac6b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.439432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.488991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:19.506321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73075b38-31dc-45ad-912a-36524ee88828 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.506492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f598-8716-454a-822a-08f465e1ac6b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.510109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d926235-b976-4f41-bf41-b50648827ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.510265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8848c37-e3ed-440d-a0ec-b7e6fa31f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.510837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848c37-e3ed-440d-a0ec-b7e6fa31f982 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.510952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d926235-b976-4f41-bf41-b50648827ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.511132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848c37-e3ed-440d-a0ec-b7e6fa31f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.511253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d926235-b976-4f41-bf41-b50648827ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.511408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848c37-e3ed-440d-a0ec-b7e6fa31f982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.511506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d926235-b976-4f41-bf41-b50648827ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.512089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d926235-b976-4f41-bf41-b50648827ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.512214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8848c37-e3ed-440d-a0ec-b7e6fa31f982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.514143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d926235-b976-4f41-bf41-b50648827ad9 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.514567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8848c37-e3ed-440d-a0ec-b7e6fa31f982 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.529208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 790/1579] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:19.529413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 790/1580] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:19.529413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8848c37-e3ed-440d-a0ec-b7e6fa31f982 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.529599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d926235-b976-4f41-bf41-b50648827ad9 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.539370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8848c37-e3ed-440d-a0ec-b7e6fa31f982 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.540785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d926235-b976-4f41-bf41-b50648827ad9 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.545232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e81e3-1557-48d6-ac44-95be69b4f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.546086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e81e3-1557-48d6-ac44-95be69b4f3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.546359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e81e3-1557-48d6-ac44-95be69b4f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.546680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e81e3-1557-48d6-ac44-95be69b4f3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.547429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e81e3-1557-48d6-ac44-95be69b4f3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.549053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cfa4d-e8d9-4517-b5d0-75bf2a685148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.549362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e81e3-1557-48d6-ac44-95be69b4f3e2 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.550486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cfa4d-e8d9-4517-b5d0-75bf2a685148 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.551078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cfa4d-e8d9-4517-b5d0-75bf2a685148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.551367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cfa4d-e8d9-4517-b5d0-75bf2a685148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.552600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cfa4d-e8d9-4517-b5d0-75bf2a685148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.555654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cfa4d-e8d9-4517-b5d0-75bf2a685148 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.652712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 791/1581] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:19 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:19.652712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e81e3-1557-48d6-ac44-95be69b4f3e2 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.677131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 791/1582] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:19 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:19.680425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cfa4d-e8d9-4517-b5d0-75bf2a685148 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.707443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e81e3-1557-48d6-ac44-95be69b4f3e2 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.750518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cfa4d-e8d9-4517-b5d0-75bf2a685148 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.755321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4fea-f32c-40d5-a5b1-7c230c07ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.755947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4fea-f32c-40d5-a5b1-7c230c07ec00 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.756225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4fea-f32c-40d5-a5b1-7c230c07ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.756502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4fea-f32c-40d5-a5b1-7c230c07ec00 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.757205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b4fea-f32c-40d5-a5b1-7c230c07ec00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.759271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b4fea-f32c-40d5-a5b1-7c230c07ec00 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.775351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec320b2-ee3f-4738-ace6-ff02f88ddbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.775986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec320b2-ee3f-4738-ace6-ff02f88ddbbb admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.781018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec320b2-ee3f-4738-ace6-ff02f88ddbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.781018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec320b2-ee3f-4738-ace6-ff02f88ddbbb admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.781018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec320b2-ee3f-4738-ace6-ff02f88ddbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.781018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec320b2-ee3f-4738-ace6-ff02f88ddbbb admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.897728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:19.902092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 792/1583] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:19 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:19.908670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec320b2-ee3f-4738-ace6-ff02f88ddbbb admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.912530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 792/1584] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:19 2022] POST /identity/v3/users => generated 303 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:19.913973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4fea-f32c-40d5-a5b1-7c230c07ec00 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.926201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec320b2-ee3f-4738-ace6-ff02f88ddbbb admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.932600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4fea-f32c-40d5-a5b1-7c230c07ec00 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.933696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fcdf1-d488-4bbe-8aa5-c1dcecef02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.935473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fcdf1-d488-4bbe-8aa5-c1dcecef02bf admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.936017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fcdf1-d488-4bbe-8aa5-c1dcecef02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.936931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fcdf1-d488-4bbe-8aa5-c1dcecef02bf admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.938218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fcdf1-d488-4bbe-8aa5-c1dcecef02bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.941989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fcdf1-d488-4bbe-8aa5-c1dcecef02bf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.947108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170caeab-7bbe-4785-a1b0-ced682ee7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.947108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170caeab-7bbe-4785-a1b0-ced682ee7dab admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.947108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170caeab-7bbe-4785-a1b0-ced682ee7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.947108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170caeab-7bbe-4785-a1b0-ced682ee7dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:19.947580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170caeab-7bbe-4785-a1b0-ced682ee7dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:19.948302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170caeab-7bbe-4785-a1b0-ced682ee7dab admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:19.970873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 793/1585] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:19.970873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170caeab-7bbe-4785-a1b0-ced682ee7dab admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:19.981205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170caeab-7bbe-4785-a1b0-ced682ee7dab admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:19.987152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5891-7567-48ba-a4db-22bd0b2b7d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:19.989285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5891-7567-48ba-a4db-22bd0b2b7d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:19.989667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5891-7567-48ba-a4db-22bd0b2b7d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:19.990011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa5891-7567-48ba-a4db-22bd0b2b7d68 admin admin] PATH_INFO: `/v3/projects/2c38062a586847d49d91c11739ee2418/users/06323c8fcf99441f9f87db199e93c8b8/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.007210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa5891-7567-48ba-a4db-22bd0b2b7d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c38062a586847d49d91c11739ee2418, user_id=06323c8fcf99441f9f87db199e93c8b8, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.010025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa5891-7567-48ba-a4db-22bd0b2b7d68 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.045553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 793/1586] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:19 2022] POST /identity/v3/users => generated 278 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:20.045553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fcdf1-d488-4bbe-8aa5-c1dcecef02bf admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.056956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fcdf1-d488-4bbe-8aa5-c1dcecef02bf admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.062093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffb03c-c2df-4296-bde9-654f32c85a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.062924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffb03c-c2df-4296-bde9-654f32c85a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.063112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffb03c-c2df-4296-bde9-654f32c85a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.063387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffb03c-c2df-4296-bde9-654f32c85a80 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.064193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffb03c-c2df-4296-bde9-654f32c85a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.066214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffb03c-c2df-4296-bde9-654f32c85a80 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.134824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 794/1587] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:19 2022] PUT /identity/v3/projects/2c38062a586847d49d91c11739ee2418/users/06323c8fcf99441f9f87db199e93c8b8/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:20.135743 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5891-7567-48ba-a4db-22bd0b2b7d68 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.159446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 794/1588] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:20 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:20.161729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffb03c-c2df-4296-bde9-654f32c85a80 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.174650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffb03c-c2df-4296-bde9-654f32c85a80 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.199834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:20.211178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa5891-7567-48ba-a4db-22bd0b2b7d68 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.217206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5563c0-df9b-484b-a276-5e44ff3c32dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.217768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5563c0-df9b-484b-a276-5e44ff3c32dc admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.218050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5563c0-df9b-484b-a276-5e44ff3c32dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.218332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5563c0-df9b-484b-a276-5e44ff3c32dc admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.219006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5563c0-df9b-484b-a276-5e44ff3c32dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.221059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5563c0-df9b-484b-a276-5e44ff3c32dc admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.241867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9cfdb-49e2-4561-b12a-4c770db6c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.242583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cfdb-49e2-4561-b12a-4c770db6c116 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.242929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cfdb-49e2-4561-b12a-4c770db6c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.248924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9cfdb-49e2-4561-b12a-4c770db6c116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.248924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9cfdb-49e2-4561-b12a-4c770db6c116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.248924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9cfdb-49e2-4561-b12a-4c770db6c116 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.256328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 795/1589] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.257215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9cfdb-49e2-4561-b12a-4c770db6c116 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.266791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9cfdb-49e2-4561-b12a-4c770db6c116 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.271245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed79608-a19b-4312-a582-5b3640e2d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.272069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed79608-a19b-4312-a582-5b3640e2d590 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.272350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed79608-a19b-4312-a582-5b3640e2d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.272614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed79608-a19b-4312-a582-5b3640e2d590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.273306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed79608-a19b-4312-a582-5b3640e2d590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.274849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed79608-a19b-4312-a582-5b3640e2d590 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.285298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 796/1590] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.286045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed79608-a19b-4312-a582-5b3640e2d590 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.296138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed79608-a19b-4312-a582-5b3640e2d590 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.300545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a54e-89ac-4004-95b8-408358eafd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.301191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a54e-89ac-4004-95b8-408358eafd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.306315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a54e-89ac-4004-95b8-408358eafd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.306315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789a54e-89ac-4004-95b8-408358eafd0a admin admin] PATH_INFO: `/v3/projects/064dd468bc554ddb9507c49e62e2a2bf/users/793d3d46e32b4550b711841f2447461a/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.315996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789a54e-89ac-4004-95b8-408358eafd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=064dd468bc554ddb9507c49e62e2a2bf, user_id=793d3d46e32b4550b711841f2447461a, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.318635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789a54e-89ac-4004-95b8-408358eafd0a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.347723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 795/1591] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:20 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:20.347723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5563c0-df9b-484b-a276-5e44ff3c32dc admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.356695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5563c0-df9b-484b-a276-5e44ff3c32dc admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.361358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b9aa4-1be9-4692-869d-b6c1502904e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.361953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b9aa4-1be9-4692-869d-b6c1502904e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.362233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b9aa4-1be9-4692-869d-b6c1502904e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.362504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b9aa4-1be9-4692-869d-b6c1502904e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.363195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b9aa4-1be9-4692-869d-b6c1502904e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.364793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b9aa4-1be9-4692-869d-b6c1502904e7 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.375940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 796/1592] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.377220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1dcf6-83b8-4926-8bdd-bf3003920322 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.377505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1dcf6-83b8-4926-8bdd-bf3003920322 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.377823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1dcf6-83b8-4926-8bdd-bf3003920322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.397492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-41c1dcf6-83b8-4926-8bdd-bf3003920322 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:20.398704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-41c1dcf6-83b8-4926-8bdd-bf3003920322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:20.407302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 797/1593] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:20.408135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1dcf6-83b8-4926-8bdd-bf3003920322 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.418671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1dcf6-83b8-4926-8bdd-bf3003920322 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.424148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422af18-9e11-4e80-b69d-a6e0d16f4af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.424809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422af18-9e11-4e80-b69d-a6e0d16f4af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.425116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422af18-9e11-4e80-b69d-a6e0d16f4af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.425498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422af18-9e11-4e80-b69d-a6e0d16f4af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.426090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422af18-9e11-4e80-b69d-a6e0d16f4af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.427685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422af18-9e11-4e80-b69d-a6e0d16f4af1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.438209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 798/1594] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.439559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422af18-9e11-4e80-b69d-a6e0d16f4af1 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.454628 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 797/1595] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:20 2022] PUT /identity/v3/projects/064dd468bc554ddb9507c49e62e2a2bf/users/793d3d46e32b4550b711841f2447461a/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:20.455354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a54e-89ac-4004-95b8-408358eafd0a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.459166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422af18-9e11-4e80-b69d-a6e0d16f4af1 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.536057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789a54e-89ac-4004-95b8-408358eafd0a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.538339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4cfe3-1e57-4195-b3e6-af384ee5f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.539329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cfe3-1e57-4195-b3e6-af384ee5f662 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.539805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cfe3-1e57-4195-b3e6-af384ee5f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.540272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cfe3-1e57-4195-b3e6-af384ee5f662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.541492 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4cfe3-1e57-4195-b3e6-af384ee5f662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.543314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434cff-4194-41dc-b382-17b4684c722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.545641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434cff-4194-41dc-b382-17b4684c722f admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.545641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434cff-4194-41dc-b382-17b4684c722f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.545994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4cfe3-1e57-4195-b3e6-af384ee5f662 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.546089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434cff-4194-41dc-b382-17b4684c722f admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.547045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9434cff-4194-41dc-b382-17b4684c722f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.549844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9434cff-4194-41dc-b382-17b4684c722f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.560852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 799/1596] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.561830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4cfe3-1e57-4195-b3e6-af384ee5f662 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.567104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 798/1597] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.567950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434cff-4194-41dc-b382-17b4684c722f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.573887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4cfe3-1e57-4195-b3e6-af384ee5f662 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.578136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434cff-4194-41dc-b382-17b4684c722f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.578944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5bfb2-657d-4f7f-8a2f-f806cc93caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.579588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5bfb2-657d-4f7f-8a2f-f806cc93caa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.579870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5bfb2-657d-4f7f-8a2f-f806cc93caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.580146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5bfb2-657d-4f7f-8a2f-f806cc93caa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.580871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5bfb2-657d-4f7f-8a2f-f806cc93caa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.582834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5bfb2-657d-4f7f-8a2f-f806cc93caa2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.583002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c45fe8-347f-4f2e-8d68-3e172ca6f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.583604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45fe8-347f-4f2e-8d68-3e172ca6f3af admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.583885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45fe8-347f-4f2e-8d68-3e172ca6f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.584169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45fe8-347f-4f2e-8d68-3e172ca6f3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.584907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c45fe8-347f-4f2e-8d68-3e172ca6f3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.586520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c45fe8-347f-4f2e-8d68-3e172ca6f3af admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.594344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 800/1598] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.595199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5bfb2-657d-4f7f-8a2f-f806cc93caa2 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.596829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 799/1599] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.597775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c45fe8-347f-4f2e-8d68-3e172ca6f3af admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.607999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c45fe8-347f-4f2e-8d68-3e172ca6f3af admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.613611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d1318-3fca-4956-b6d0-b06efd6a8d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.614243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1318-3fca-4956-b6d0-b06efd6a8d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.614524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1318-3fca-4956-b6d0-b06efd6a8d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.614798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1318-3fca-4956-b6d0-b06efd6a8d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.615486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d1318-3fca-4956-b6d0-b06efd6a8d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.617177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d1318-3fca-4956-b6d0-b06efd6a8d44 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.623451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:20.630387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 800/1600] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:20.631675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb8be5-8cff-434c-9c9a-23d514c1b550 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.631965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb8be5-8cff-434c-9c9a-23d514c1b550 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.632240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb8be5-8cff-434c-9c9a-23d514c1b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.652360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-70cb8be5-8cff-434c-9c9a-23d514c1b550 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:20.653792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-70cb8be5-8cff-434c-9c9a-23d514c1b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:20.662853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 801/1601] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:20.663384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb8be5-8cff-434c-9c9a-23d514c1b550 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.672322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5bfb2-657d-4f7f-8a2f-f806cc93caa2 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.676187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb8be5-8cff-434c-9c9a-23d514c1b550 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.677796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618225-c113-4527-a783-f93dd3b54276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.678579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618225-c113-4527-a783-f93dd3b54276 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.678920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618225-c113-4527-a783-f93dd3b54276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.679204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618225-c113-4527-a783-f93dd3b54276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.685961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793df740-f072-444d-9189-43ce8003e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.686989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df740-f072-444d-9189-43ce8003e98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.687444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df740-f072-444d-9189-43ce8003e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.688004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df740-f072-444d-9189-43ce8003e98f admin admin] PATH_INFO: `/v3/projects/2f404475ba184654ba436a66969d1476/users/e6e5d240443d4a148346bf9f1270b1d5/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.694765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb618225-c113-4527-a783-f93dd3b54276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.696679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb618225-c113-4527-a783-f93dd3b54276 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.705281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793df740-f072-444d-9189-43ce8003e98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f404475ba184654ba436a66969d1476, user_id=e6e5d240443d4a148346bf9f1270b1d5, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.708560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793df740-f072-444d-9189-43ce8003e98f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.710444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 801/1602] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:20.711227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618225-c113-4527-a783-f93dd3b54276 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.725427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618225-c113-4527-a783-f93dd3b54276 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.730543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e69463-3fba-40e7-8e2e-b2d09c7ff692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.731484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69463-3fba-40e7-8e2e-b2d09c7ff692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.731484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69463-3fba-40e7-8e2e-b2d09c7ff692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.731842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69463-3fba-40e7-8e2e-b2d09c7ff692 admin admin] PATH_INFO: `/v3/projects/9125f5e91e9a4d6ca1931e17346e10da/users/af8ec760d4b84c1f8e0b7581a0032941/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:20.748028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e69463-3fba-40e7-8e2e-b2d09c7ff692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9125f5e91e9a4d6ca1931e17346e10da, user_id=af8ec760d4b84c1f8e0b7581a0032941, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:20.750740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e69463-3fba-40e7-8e2e-b2d09c7ff692 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:20.817667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 802/1603] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:20 2022] PUT /identity/v3/projects/2f404475ba184654ba436a66969d1476/users/e6e5d240443d4a148346bf9f1270b1d5/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:20.818665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793df740-f072-444d-9189-43ce8003e98f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.861838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:20.879585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 802/1604] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:20 2022] PUT /identity/v3/projects/9125f5e91e9a4d6ca1931e17346e10da/users/af8ec760d4b84c1f8e0b7581a0032941/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:20.891382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e69463-3fba-40e7-8e2e-b2d09c7ff692 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:20.947860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793df740-f072-444d-9189-43ce8003e98f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.975120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e69463-3fba-40e7-8e2e-b2d09c7ff692 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:20.980374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e92776-91ed-49e0-ac6e-ede825cce135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:20.981317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e92776-91ed-49e0-ac6e-ede825cce135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:20.981736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e92776-91ed-49e0-ac6e-ede825cce135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:20.982116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e92776-91ed-49e0-ac6e-ede825cce135 admin admin] PATH_INFO: `/v3/projects/b0827f981a374698bb0846537495deaf/users/011d7103c694467289bd58f0cf780e9f/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.000953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e92776-91ed-49e0-ac6e-ede825cce135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0827f981a374698bb0846537495deaf, user_id=011d7103c694467289bd58f0cf780e9f, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:21.005661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e92776-91ed-49e0-ac6e-ede825cce135 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:21.072168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf21f6-81c3-4581-8fca-a2b14b2ba13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:21.073367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf21f6-81c3-4581-8fca-a2b14b2ba13a admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.073830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf21f6-81c3-4581-8fca-a2b14b2ba13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.074223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf21f6-81c3-4581-8fca-a2b14b2ba13a admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.076160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf21f6-81c3-4581-8fca-a2b14b2ba13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:21.079830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf21f6-81c3-4581-8fca-a2b14b2ba13a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:21.100318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 803/1605] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:21.101718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf21f6-81c3-4581-8fca-a2b14b2ba13a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:21.121210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf21f6-81c3-4581-8fca-a2b14b2ba13a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:21.123800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 803/1606] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:20 2022] PUT /identity/v3/projects/b0827f981a374698bb0846537495deaf/users/011d7103c694467289bd58f0cf780e9f/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:21.136166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e92776-91ed-49e0-ac6e-ede825cce135 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:21.223716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e92776-91ed-49e0-ac6e-ede825cce135 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:21.227659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c656-9c47-49e7-9735-2dee2b7d870b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:21.228311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c656-9c47-49e7-9735-2dee2b7d870b service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.228594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c656-9c47-49e7-9735-2dee2b7d870b service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.228868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c656-9c47-49e7-9735-2dee2b7d870b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.231258 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00519b53-19ca-4946-8922-63cb1ae1d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:21.233748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00519b53-19ca-4946-8922-63cb1ae1d0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.234158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00519b53-19ca-4946-8922-63cb1ae1d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.234576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00519b53-19ca-4946-8922-63cb1ae1d0f1 admin admin] PATH_INFO: `/v3/projects/5a2c550e65c648ef8855e97c7e1ee540/users/c7a0a4e5e81340a6965e0ecfddcfc292/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.240163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c656-9c47-49e7-9735-2dee2b7d870b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:21.241761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c656-9c47-49e7-9735-2dee2b7d870b service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:21.252311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00519b53-19ca-4946-8922-63cb1ae1d0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2c550e65c648ef8855e97c7e1ee540, user_id=c7a0a4e5e81340a6965e0ecfddcfc292, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:21.254856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 804/1607] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:21.255113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00519b53-19ca-4946-8922-63cb1ae1d0f1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:21.256046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98545-d93a-4d11-905f-8f72b1c62822 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.256334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98545-d93a-4d11-905f-8f72b1c62822 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.256670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98545-d93a-4d11-905f-8f72b1c62822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.275694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-49d98545-d93a-4d11-905f-8f72b1c62822 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:21.277031 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-49d98545-d93a-4d11-905f-8f72b1c62822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:21.286057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 805/1608] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:21.287374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303faa5b-c4b0-4920-b466-8b6244666f94 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.287754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303faa5b-c4b0-4920-b466-8b6244666f94 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.288092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303faa5b-c4b0-4920-b466-8b6244666f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.309155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:21.326202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-303faa5b-c4b0-4920-b466-8b6244666f94 None None] MFA Rules not processed for user `af8ec760d4b84c1f8e0b7581a0032941`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:21.327774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-303faa5b-c4b0-4920-b466-8b6244666f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:21.401391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 804/1609] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:21 2022] PUT /identity/v3/projects/5a2c550e65c648ef8855e97c7e1ee540/users/c7a0a4e5e81340a6965e0ecfddcfc292/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:21.403126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00519b53-19ca-4946-8922-63cb1ae1d0f1 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:21.440803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 806/1610] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:21 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:21.443432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc5be-429d-40b1-9320-e30e07a498f4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.443432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc5be-429d-40b1-9320-e30e07a498f4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.444284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc5be-429d-40b1-9320-e30e07a498f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.496281 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-0f0bc5be-429d-40b1-9320-e30e07a498f4 None None] MFA Rules not processed for user `011d7103c694467289bd58f0cf780e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:21.501141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0f0bc5be-429d-40b1-9320-e30e07a498f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:21.543206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:21.552861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00519b53-19ca-4946-8922-63cb1ae1d0f1 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:21.563759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c002cea-d9fe-45dc-bbea-68b7de51494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:21.565340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c002cea-d9fe-45dc-bbea-68b7de51494d admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.569674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c002cea-d9fe-45dc-bbea-68b7de51494d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.569674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c002cea-d9fe-45dc-bbea-68b7de51494d admin admin] PATH_INFO: `/v3/projects/167700163b7c48bea6b6d0da9b61d39f/users/08c83e5f57c341918a74006d47a4249d/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.592642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c002cea-d9fe-45dc-bbea-68b7de51494d admin admin] RBAC: Authorizing `identity:create_grant(project_id=167700163b7c48bea6b6d0da9b61d39f, user_id=08c83e5f57c341918a74006d47a4249d, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:21.596085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c002cea-d9fe-45dc-bbea-68b7de51494d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:21.606865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 807/1611] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:21.606865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bc5be-429d-40b1-9320-e30e07a498f4 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:21.607315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0f0bc5be-429d-40b1-9320-e30e07a498f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:21.730760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 805/1612] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:21 2022] PUT /identity/v3/projects/167700163b7c48bea6b6d0da9b61d39f/users/08c83e5f57c341918a74006d47a4249d/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:21.736474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf5300-971f-4576-9ad1-c4e911148476 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.736756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf5300-971f-4576-9ad1-c4e911148476 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.737060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf5300-971f-4576-9ad1-c4e911148476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.754133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bc5be-429d-40b1-9320-e30e07a498f4 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:21.811142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a5cf5300-971f-4576-9ad1-c4e911148476 None None] MFA Rules not processed for user `c7a0a4e5e81340a6965e0ecfddcfc292`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:21.812401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a5cf5300-971f-4576-9ad1-c4e911148476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:21.827006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:21.849218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6274e6-945b-4cf7-bfe7-3d79b66fadd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:21.850470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6274e6-945b-4cf7-bfe7-3d79b66fadd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:21.850470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6274e6-945b-4cf7-bfe7-3d79b66fadd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:21.850895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6274e6-945b-4cf7-bfe7-3d79b66fadd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:21.957316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6274e6-945b-4cf7-bfe7-3d79b66fadd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:21.959134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6274e6-945b-4cf7-bfe7-3d79b66fadd6 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:21.969282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 806/1613] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:21.970364 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf5300-971f-4576-9ad1-c4e911148476 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:21.979046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 808/1614] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:22.049776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf5300-971f-4576-9ad1-c4e911148476 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.056396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6274e6-945b-4cf7-bfe7-3d79b66fadd6 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.057015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b09a95-8469-4eb3-82be-0cded9078672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.057015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09a95-8469-4eb3-82be-0cded9078672 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.057015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09a95-8469-4eb3-82be-0cded9078672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.057015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b09a95-8469-4eb3-82be-0cded9078672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.057526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b09a95-8469-4eb3-82be-0cded9078672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.057526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b09a95-8469-4eb3-82be-0cded9078672 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.057792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6274e6-945b-4cf7-bfe7-3d79b66fadd6 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.067652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfffed7-4f07-4c7c-a5ef-602d14743c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.070517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfffed7-4f07-4c7c-a5ef-602d14743c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.070517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfffed7-4f07-4c7c-a5ef-602d14743c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.070517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfffed7-4f07-4c7c-a5ef-602d14743c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.075460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfffed7-4f07-4c7c-a5ef-602d14743c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.083722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfffed7-4f07-4c7c-a5ef-602d14743c2f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.223121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 807/1615] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:21 2022] POST /identity/v3/projects => generated 405 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:22.224552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eafbe8-1959-4040-b5c6-7700a58ba0ca None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.224851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eafbe8-1959-4040-b5c6-7700a58ba0ca None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.225290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eafbe8-1959-4040-b5c6-7700a58ba0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.245908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f7eafbe8-1959-4040-b5c6-7700a58ba0ca None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:22.247719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f7eafbe8-1959-4040-b5c6-7700a58ba0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:22.248929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 809/1616] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:21 2022] POST /identity/v3/projects => generated 357 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:22.250452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bada8de-a0c2-4bad-bfd7-59523e4a24c1 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.250903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bada8de-a0c2-4bad-bfd7-59523e4a24c1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.251260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bada8de-a0c2-4bad-bfd7-59523e4a24c1 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.253261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 810/1617] 10.222.0.93 () {54 vars in 962 bytes} [Thu Aug 4 21:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:24:22.255251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bada8de-a0c2-4bad-bfd7-59523e4a24c1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.338403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 808/1618] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:22.338994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eafbe8-1959-4040-b5c6-7700a58ba0ca None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.369887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bada8de-a0c2-4bad-bfd7-59523e4a24c1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.370401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eafbe8-1959-4040-b5c6-7700a58ba0ca None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.376940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf19fe-380e-4b14-9adf-d29d5f621e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.377680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf19fe-380e-4b14-9adf-d29d5f621e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.377959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf19fe-380e-4b14-9adf-d29d5f621e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.378228 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf19fe-380e-4b14-9adf-d29d5f621e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.378907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf19fe-380e-4b14-9adf-d29d5f621e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.380842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf19fe-380e-4b14-9adf-d29d5f621e5c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.391472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2d741-6125-4bcb-b9ee-9bb4daa68b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.392451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d741-6125-4bcb-b9ee-9bb4daa68b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.392919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d741-6125-4bcb-b9ee-9bb4daa68b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.393751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d741-6125-4bcb-b9ee-9bb4daa68b04 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.394672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2d741-6125-4bcb-b9ee-9bb4daa68b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.397601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2d741-6125-4bcb-b9ee-9bb4daa68b04 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.480817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 811/1619] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:22 2022] POST /identity/v3/users => generated 309 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:22.482236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9242e0-2fe9-48b0-8d4a-35ec93aa4682 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.482389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9242e0-2fe9-48b0-8d4a-35ec93aa4682 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.482628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9242e0-2fe9-48b0-8d4a-35ec93aa4682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.494189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 809/1620] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:22 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:22.500491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf19fe-380e-4b14-9adf-d29d5f621e5c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.573359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ff9242e0-2fe9-48b0-8d4a-35ec93aa4682 None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:22.574897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ff9242e0-2fe9-48b0-8d4a-35ec93aa4682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:22.619035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:22.668059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:22.684301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf19fe-380e-4b14-9adf-d29d5f621e5c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.695087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e12ef-293d-431a-ac8e-2b2dd2488712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.695762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e12ef-293d-431a-ac8e-2b2dd2488712 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.696043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e12ef-293d-431a-ac8e-2b2dd2488712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.696318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e12ef-293d-431a-ac8e-2b2dd2488712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.714431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e12ef-293d-431a-ac8e-2b2dd2488712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.715975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e12ef-293d-431a-ac8e-2b2dd2488712 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.756645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 812/1621] 10.222.0.93 () {58 vars in 1059 bytes} [Thu Aug 4 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:22.756645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9242e0-2fe9-48b0-8d4a-35ec93aa4682 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.761108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 810/1622] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:22.761847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e12ef-293d-431a-ac8e-2b2dd2488712 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.770337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9242e0-2fe9-48b0-8d4a-35ec93aa4682 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.776563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e12ef-293d-431a-ac8e-2b2dd2488712 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.783006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc65b63-c928-4864-bcf6-68a4284196e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.783785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc65b63-c928-4864-bcf6-68a4284196e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.783905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc65b63-c928-4864-bcf6-68a4284196e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.784155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc65b63-c928-4864-bcf6-68a4284196e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.785066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc65b63-c928-4864-bcf6-68a4284196e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.788570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9b07a-5b50-49f7-8fa4-fdf35a912e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.788734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc65b63-c928-4864-bcf6-68a4284196e1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.788969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b07a-5b50-49f7-8fa4-fdf35a912e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.789855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b07a-5b50-49f7-8fa4-fdf35a912e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.791017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b07a-5b50-49f7-8fa4-fdf35a912e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.791930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9b07a-5b50-49f7-8fa4-fdf35a912e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.797655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9b07a-5b50-49f7-8fa4-fdf35a912e2f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.800196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 811/1623] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:22.801500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc65b63-c928-4864-bcf6-68a4284196e1 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.813516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 813/1624] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:22.814972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9b07a-5b50-49f7-8fa4-fdf35a912e2f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.820483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc65b63-c928-4864-bcf6-68a4284196e1 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.827988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117adf4-6fb9-48d3-a562-7b29a8f37055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.840410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9b07a-5b50-49f7-8fa4-fdf35a912e2f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.840568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117adf4-6fb9-48d3-a562-7b29a8f37055 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.840568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117adf4-6fb9-48d3-a562-7b29a8f37055 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.840568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117adf4-6fb9-48d3-a562-7b29a8f37055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.840841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4312004-8c26-44e4-b8fa-2fcf165c4a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.840841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312004-8c26-44e4-b8fa-2fcf165c4a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.840841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312004-8c26-44e4-b8fa-2fcf165c4a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.840841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312004-8c26-44e4-b8fa-2fcf165c4a66 admin admin] PATH_INFO: `/v3/projects/6e3353520dcf48feb617fb048bed4f80/users/92aea733a6bb43c68fe453ccd0405f44/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.870047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4312004-8c26-44e4-b8fa-2fcf165c4a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3353520dcf48feb617fb048bed4f80, user_id=92aea733a6bb43c68fe453ccd0405f44, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.873687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4312004-8c26-44e4-b8fa-2fcf165c4a66 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.919715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117adf4-6fb9-48d3-a562-7b29a8f37055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:22.922169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117adf4-6fb9-48d3-a562-7b29a8f37055 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:22.947806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 812/1625] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:22.949337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117adf4-6fb9-48d3-a562-7b29a8f37055 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:22.970379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117adf4-6fb9-48d3-a562-7b29a8f37055 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:22.985268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af7d0-d8da-4ac6-9cac-9e073740f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:22.986045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af7d0-d8da-4ac6-9cac-9e073740f3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:22.986340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af7d0-d8da-4ac6-9cac-9e073740f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:22.986659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41af7d0-d8da-4ac6-9cac-9e073740f3b9 admin admin] PATH_INFO: `/v3/projects/1a3c4c4e7c014cf88a5b14972c29365a/users/e2a95e51294f4566b5e7da6c1c1aabde/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:22.987841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 814/1626] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:22 2022] PUT /identity/v3/projects/6e3353520dcf48feb617fb048bed4f80/users/92aea733a6bb43c68fe453ccd0405f44/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:22.992509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4312004-8c26-44e4-b8fa-2fcf165c4a66 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:23.027072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af7d0-d8da-4ac6-9cac-9e073740f3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c4c4e7c014cf88a5b14972c29365a, user_id=e2a95e51294f4566b5e7da6c1c1aabde, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:23.032184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41af7d0-d8da-4ac6-9cac-9e073740f3b9 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:23.118851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 813/1627] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:22 2022] PUT /identity/v3/projects/1a3c4c4e7c014cf88a5b14972c29365a/users/e2a95e51294f4566b5e7da6c1c1aabde/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:23.120010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af7d0-d8da-4ac6-9cac-9e073740f3b9 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:23.150555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4312004-8c26-44e4-b8fa-2fcf165c4a66 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:23.250127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41af7d0-d8da-4ac6-9cac-9e073740f3b9 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:23.260129 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068281-e16c-4f71-841d-ff6553a6027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:23.260766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068281-e16c-4f71-841d-ff6553a6027e admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.261067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068281-e16c-4f71-841d-ff6553a6027e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.261334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068281-e16c-4f71-841d-ff6553a6027e admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.262032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068281-e16c-4f71-841d-ff6553a6027e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:23.264826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068281-e16c-4f71-841d-ff6553a6027e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:23.281329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8560-bd3d-45c9-801e-d26529c1f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:23.282148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8560-bd3d-45c9-801e-d26529c1f370 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.282435 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8560-bd3d-45c9-801e-d26529c1f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.282709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8560-bd3d-45c9-801e-d26529c1f370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.283424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef8560-bd3d-45c9-801e-d26529c1f370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:23.285636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef8560-bd3d-45c9-801e-d26529c1f370 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:23.290079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 814/1628] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:24:23.294424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068281-e16c-4f71-841d-ff6553a6027e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:23.303508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 815/1629] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:23.305251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8560-bd3d-45c9-801e-d26529c1f370 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:23.315921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068281-e16c-4f71-841d-ff6553a6027e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:23.318698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8560-bd3d-45c9-801e-d26529c1f370 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:23.324545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690c848-0898-4a31-8c05-e05c3d3b4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:23.326375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c848-0898-4a31-8c05-e05c3d3b4674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.326857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c848-0898-4a31-8c05-e05c3d3b4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.327241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c848-0898-4a31-8c05-e05c3d3b4674 admin admin] PATH_INFO: `/v3/projects/6e3353520dcf48feb617fb048bed4f80/users/92aea733a6bb43c68fe453ccd0405f44/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.330928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e5fec-039e-42df-97e2-c54e35742676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:23.331621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5fec-039e-42df-97e2-c54e35742676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.331880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690c848-0898-4a31-8c05-e05c3d3b4674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3353520dcf48feb617fb048bed4f80, user_id=92aea733a6bb43c68fe453ccd0405f44, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:23.332331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5fec-039e-42df-97e2-c54e35742676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.332613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e5fec-039e-42df-97e2-c54e35742676 admin admin] PATH_INFO: `/v3/projects/1a3c4c4e7c014cf88a5b14972c29365a/users/e2a95e51294f4566b5e7da6c1c1aabde/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.336260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690c848-0898-4a31-8c05-e05c3d3b4674 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:23.338933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5fec-039e-42df-97e2-c54e35742676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c4c4e7c014cf88a5b14972c29365a, user_id=e2a95e51294f4566b5e7da6c1c1aabde, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:23.342056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e5fec-039e-42df-97e2-c54e35742676 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:23.364938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 816/1630] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:23 2022] PUT /identity/v3/projects/6e3353520dcf48feb617fb048bed4f80/users/92aea733a6bb43c68fe453ccd0405f44/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:23.367824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ace3-16ee-4f20-ac4d-ff9f2ed82a50 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.368166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ace3-16ee-4f20-ac4d-ff9f2ed82a50 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.368597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ace3-16ee-4f20-ac4d-ff9f2ed82a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.369609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 815/1631] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:23 2022] PUT /identity/v3/projects/1a3c4c4e7c014cf88a5b14972c29365a/users/e2a95e51294f4566b5e7da6c1c1aabde/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:23.386689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f96d3-2fb3-4107-810f-25556f0b79f9 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.387213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f96d3-2fb3-4107-810f-25556f0b79f9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.387660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f96d3-2fb3-4107-810f-25556f0b79f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.434698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-d57f96d3-2fb3-4107-810f-25556f0b79f9 None None] MFA Rules not processed for user `e2a95e51294f4566b5e7da6c1c1aabde`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:23.437429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1131ace3-16ee-4f20-ac4d-ff9f2ed82a50 None None] MFA Rules not processed for user `92aea733a6bb43c68fe453ccd0405f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:23.437803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d57f96d3-2fb3-4107-810f-25556f0b79f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:23.439639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1131ace3-16ee-4f20-ac4d-ff9f2ed82a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:23.445193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:23.541895 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 816/1632] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:23.543422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 817/1633] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:23.543935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562424-b0f7-4439-8727-cf362eeffbe4 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.545059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562424-b0f7-4439-8727-cf362eeffbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.545768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b562424-b0f7-4439-8727-cf362eeffbe4 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.547583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 817/1634] 10.222.0.93 () {54 vars in 912 bytes} [Thu Aug 4 21:24:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:24:23.563323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131ace3-16ee-4f20-ac4d-ff9f2ed82a50 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:23.569121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562424-b0f7-4439-8727-cf362eeffbe4 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:23.657600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131ace3-16ee-4f20-ac4d-ff9f2ed82a50 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:23.665739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee461f4-dc96-4f99-94df-e9ffa2bac146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:23.666776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee461f4-dc96-4f99-94df-e9ffa2bac146 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.666776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee461f4-dc96-4f99-94df-e9ffa2bac146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.666992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee461f4-dc96-4f99-94df-e9ffa2bac146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.686510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:23.691791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b562424-b0f7-4439-8727-cf362eeffbe4 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:23.702442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca8805-1202-4de0-a526-034e734c7b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:23.703463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8805-1202-4de0-a526-034e734c7b1b service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.703947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8805-1202-4de0-a526-034e734c7b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.704937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca8805-1202-4de0-a526-034e734c7b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.714035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee461f4-dc96-4f99-94df-e9ffa2bac146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:23.720367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee461f4-dc96-4f99-94df-e9ffa2bac146 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:23.728524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca8805-1202-4de0-a526-034e734c7b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:23.731219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca8805-1202-4de0-a526-034e734c7b1b service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:23.751727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 818/1635] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:23 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:23.755559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 818/1636] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:23.757928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134786b-4e5d-4229-aa73-6c9a2836da50 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:23.758239 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134786b-4e5d-4229-aa73-6c9a2836da50 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:23.760680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134786b-4e5d-4229-aa73-6c9a2836da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:23.806248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4134786b-4e5d-4229-aa73-6c9a2836da50 None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:23.809203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4134786b-4e5d-4229-aa73-6c9a2836da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:24.100838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 819/1637] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:24.109175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee461f4-dc96-4f99-94df-e9ffa2bac146 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:24.109175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee461f4-dc96-4f99-94df-e9ffa2bac146 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:24.109175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27e26e-0f1e-4eeb-a774-2dbcd6b62a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:24.109175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27e26e-0f1e-4eeb-a774-2dbcd6b62a5c service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:24.111290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27e26e-0f1e-4eeb-a774-2dbcd6b62a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:24.111290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27e26e-0f1e-4eeb-a774-2dbcd6b62a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:24.111290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27e26e-0f1e-4eeb-a774-2dbcd6b62a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:24.111290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27e26e-0f1e-4eeb-a774-2dbcd6b62a5c service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:24.111290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 819/1638] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:24.284066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134786b-4e5d-4229-aa73-6c9a2836da50 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:24.293633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27e26e-0f1e-4eeb-a774-2dbcd6b62a5c service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:24.304249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27e26e-0f1e-4eeb-a774-2dbcd6b62a5c service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:24.308759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4da6d0-2bb1-4a8b-a2a6-f63bfcb43fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:24.309761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da6d0-2bb1-4a8b-a2a6-f63bfcb43fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:24.310803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da6d0-2bb1-4a8b-a2a6-f63bfcb43fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:24.311341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da6d0-2bb1-4a8b-a2a6-f63bfcb43fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:24.438059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4da6d0-2bb1-4a8b-a2a6-f63bfcb43fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:24.439537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4da6d0-2bb1-4a8b-a2a6-f63bfcb43fb1 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:24.440511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134786b-4e5d-4229-aa73-6c9a2836da50 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:24.452807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 820/1639] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:24:24.456614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:24.457504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:24.457787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:24.458063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] PATH_INFO: `/v3/users/af8ec760d4b84c1f8e0b7581a0032941` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:24.462447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8ec760d4b84c1f8e0b7581a0032941)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:24.464924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:24.801369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:24.951281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8ec760d4b84c1f8e0b7581a0032941'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:24.952093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8ec760d4b84c1f8e0b7581a0032941'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:24.953600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8ec760d4b84c1f8e0b7581a0032941'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:24.982797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8ec760d4b84c1f8e0b7581a0032941'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:25.069780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8ec760d4b84c1f8e0b7581a0032941'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:25.092086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 820/1640] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:24:24 2022] DELETE /identity/v3/users/af8ec760d4b84c1f8e0b7581a0032941 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:25.100483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a5686-57d0-424d-87ce-f5fbcb54891b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:25.100860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a5686-57d0-424d-87ce-f5fbcb54891b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:25.101064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a5686-57d0-424d-87ce-f5fbcb54891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:25.155605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-272a5686-57d0-424d-87ce-f5fbcb54891b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:25.157260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-272a5686-57d0-424d-87ce-f5fbcb54891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:25.258225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:25.295265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 821/1641] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:25.306538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:25.308126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:25.422207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c56c9-05fd-466f-b997-44c2ea3e0b7c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:25.426485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6adb8a-09fc-4978-aedd-e8feeac7e55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:25.427231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adb8a-09fc-4978-aedd-e8feeac7e55d service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:25.427573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adb8a-09fc-4978-aedd-e8feeac7e55d service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:25.428071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adb8a-09fc-4978-aedd-e8feeac7e55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:25.479010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6adb8a-09fc-4978-aedd-e8feeac7e55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:25.483129 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6adb8a-09fc-4978-aedd-e8feeac7e55d service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:25.511814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 821/1642] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:25.984412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5682dc-b274-46e8-a36a-dd3aeaa6f41b None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:25.984712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5682dc-b274-46e8-a36a-dd3aeaa6f41b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:25.985066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5682dc-b274-46e8-a36a-dd3aeaa6f41b None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:25.986980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 822/1643] 10.222.0.93 () {54 vars in 962 bytes} [Thu Aug 4 21:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:24:25.995307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee2d1-97fd-4866-b133-f669808550c4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:25.995307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee2d1-97fd-4866-b133-f669808550c4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:25.996587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ee2d1-97fd-4866-b133-f669808550c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:26.022280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a66ee2d1-97fd-4866-b133-f669808550c4 None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:26.023650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a66ee2d1-97fd-4866-b133-f669808550c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:26.096865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:26.122028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 822/1644] 10.222.0.93 () {58 vars in 1059 bytes} [Thu Aug 4 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:26.130937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94a8db-e19e-4e00-bf46-859ecfb9c972 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:26.131148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94a8db-e19e-4e00-bf46-859ecfb9c972 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:26.131919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94a8db-e19e-4e00-bf46-859ecfb9c972 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:26.133644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 823/1645] 10.222.0.93 () {54 vars in 912 bytes} [Thu Aug 4 21:24:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:24:26.146185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654965e-1898-4e55-9356-4e1fdf1e9462 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:26.146621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654965e-1898-4e55-9356-4e1fdf1e9462 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:26.147345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654965e-1898-4e55-9356-4e1fdf1e9462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:26.199391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a654965e-1898-4e55-9356-4e1fdf1e9462 None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:26.211075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a654965e-1898-4e55-9356-4e1fdf1e9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:26.239662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 823/1646] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:26.252607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94a8db-e19e-4e00-bf46-859ecfb9c972 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:26.254531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0b94a8db-e19e-4e00-bf46-859ecfb9c972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:26.401493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94a8db-e19e-4e00-bf46-859ecfb9c972 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:26.408398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79437a36-1af2-44e1-a6fb-fe4807f5d367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:26.409758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79437a36-1af2-44e1-a6fb-fe4807f5d367 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:26.414300 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79437a36-1af2-44e1-a6fb-fe4807f5d367 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:26.415180 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79437a36-1af2-44e1-a6fb-fe4807f5d367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:26.440719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79437a36-1af2-44e1-a6fb-fe4807f5d367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:26.449864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79437a36-1af2-44e1-a6fb-fe4807f5d367 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:26.500499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 824/1647] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:24:27.543878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654965e-1898-4e55-9356-4e1fdf1e9462 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:27.543878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a654965e-1898-4e55-9356-4e1fdf1e9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:27.569662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654965e-1898-4e55-9356-4e1fdf1e9462 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:27.587515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:27.588473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:27.588957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:27.589473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] PATH_INFO: `/v3/projects/9125f5e91e9a4d6ca1931e17346e10da` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:27.592409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9125f5e91e9a4d6ca1931e17346e10da)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:27.593746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: WARNING py.warnings [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:24:27.593746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: warnings.warn(msg) Aug 04 21:24:27.593746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: Aug 04 21:24:27.601416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:27.870478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9125f5e91e9a4d6ca1931e17346e10da', 'request_id': 'req-114ff93b-9751-4628-9d95-e38a38c912da'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:27.879024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9125f5e91e9a4d6ca1931e17346e10da', 'request_id': 'req-114ff93b-9751-4628-9d95-e38a38c912da'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:27.955543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9125f5e91e9a4d6ca1931e17346e10da', 'request_id': 'req-114ff93b-9751-4628-9d95-e38a38c912da'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:28.002179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] The token cache is being invalidate because project 9125f5e91e9a4d6ca1931e17346e10da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:24:28.002479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:28.009535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:28.022114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 824/1648] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:24:27 2022] DELETE /identity/v3/projects/9125f5e91e9a4d6ca1931e17346e10da => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:28.023393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79437a36-1af2-44e1-a6fb-fe4807f5d367 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:28.051955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79437a36-1af2-44e1-a6fb-fe4807f5d367 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:28.142932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:28.144489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:28.144861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:28.145280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] PATH_INFO: `/v3/users/e2a95e51294f4566b5e7da6c1c1aabde` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:28.148297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a95e51294f4566b5e7da6c1c1aabde)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:28.149576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: WARNING py.warnings [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 21:24:28.149576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: warnings.warn(msg) Aug 04 21:24:28.149576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: Aug 04 21:24:28.151037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:28.614144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a95e51294f4566b5e7da6c1c1aabde'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:28.643142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a95e51294f4566b5e7da6c1c1aabde'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:28.744193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a95e51294f4566b5e7da6c1c1aabde'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:28.817624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a95e51294f4566b5e7da6c1c1aabde'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:28.821298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-afcd25ae-6271-47c1-9a37-f16844bdd6d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a95e51294f4566b5e7da6c1c1aabde'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:28.846905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 825/1649] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:24:28 2022] DELETE /identity/v3/users/e2a95e51294f4566b5e7da6c1c1aabde => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:24:30.985314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:30.985314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:31.017567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ff93b-9751-4628-9d95-e38a38c912da admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:31.155200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:31.160251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:31.165726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:31.165726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] PATH_INFO: `/v3/projects/1a3c4c4e7c014cf88a5b14972c29365a` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:31.165726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3c4c4e7c014cf88a5b14972c29365a)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:31.165726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:31.342779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3c4c4e7c014cf88a5b14972c29365a', 'request_id': 'req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:31.350467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3c4c4e7c014cf88a5b14972c29365a', 'request_id': 'req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:31.514396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3c4c4e7c014cf88a5b14972c29365a', 'request_id': 'req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:31.538917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:31.557103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] The token cache is being invalidate because project 1a3c4c4e7c014cf88a5b14972c29365a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:24:31.557802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:31.562808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9ad7d9a5-3c57-4fa1-bf48-4e9965e87113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:31.565225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 825/1650] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:24:30 2022] DELETE /identity/v3/projects/1a3c4c4e7c014cf88a5b14972c29365a => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:31.569929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056fc9-39b8-4302-bc1c-0474bf3fae55 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:31.570484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056fc9-39b8-4302-bc1c-0474bf3fae55 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:31.570727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056fc9-39b8-4302-bc1c-0474bf3fae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:31.631174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-92056fc9-39b8-4302-bc1c-0474bf3fae55 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:31.639075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-92056fc9-39b8-4302-bc1c-0474bf3fae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:31.662795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:31.808673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 826/1651] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:31.810912 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0678ea-6b57-4828-a956-5f2d8deab0ee None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:31.811313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0678ea-6b57-4828-a956-5f2d8deab0ee None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:31.811491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0678ea-6b57-4828-a956-5f2d8deab0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:31.861443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0b0678ea-6b57-4828-a956-5f2d8deab0ee None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:31.862127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0b0678ea-6b57-4828-a956-5f2d8deab0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:31.899849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 826/1652] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:31.903787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056fc9-39b8-4302-bc1c-0474bf3fae55 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:31.930729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056fc9-39b8-4302-bc1c-0474bf3fae55 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:31.964836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:31.965415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:31.965698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:31.968819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:31.970096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:31.970601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:31.973644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:31.992928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 827/1653] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:31.998060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0678ea-6b57-4828-a956-5f2d8deab0ee None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:32.019770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0678ea-6b57-4828-a956-5f2d8deab0ee None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:32.036229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987b93f-5bcb-4bdd-8f1b-d1a785624e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:32.037152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987b93f-5bcb-4bdd-8f1b-d1a785624e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:32.037750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987b93f-5bcb-4bdd-8f1b-d1a785624e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:32.038236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987b93f-5bcb-4bdd-8f1b-d1a785624e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:32.039130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987b93f-5bcb-4bdd-8f1b-d1a785624e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:32.045585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987b93f-5bcb-4bdd-8f1b-d1a785624e8c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:32.182188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 827/1654] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:31 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:32.189165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:32.199620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2443ce4-f970-4d4f-b5f4-e94f03b78daa admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:32.292299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0633ec-ee4a-4319-94ca-49e2fe7b2e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:32.292299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0633ec-ee4a-4319-94ca-49e2fe7b2e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:32.292299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0633ec-ee4a-4319-94ca-49e2fe7b2e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:32.292299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0633ec-ee4a-4319-94ca-49e2fe7b2e3b admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:32.293012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0633ec-ee4a-4319-94ca-49e2fe7b2e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:32.296415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0633ec-ee4a-4319-94ca-49e2fe7b2e3b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:32.402693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 828/1655] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:32 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:32.409609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987b93f-5bcb-4bdd-8f1b-d1a785624e8c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:32.428516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987b93f-5bcb-4bdd-8f1b-d1a785624e8c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:32.441395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d741-6865-4f7a-9a5b-99e58b226b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:32.443473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d741-6865-4f7a-9a5b-99e58b226b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:32.447401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d741-6865-4f7a-9a5b-99e58b226b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:32.447401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d741-6865-4f7a-9a5b-99e58b226b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:32.447401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6d741-6865-4f7a-9a5b-99e58b226b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:32.464376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6d741-6865-4f7a-9a5b-99e58b226b4c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:32.487806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 828/1656] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:32.493806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0633ec-ee4a-4319-94ca-49e2fe7b2e3b admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:32.569052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0633ec-ee4a-4319-94ca-49e2fe7b2e3b admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:32.584463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3ea6-5acb-44a8-959f-78a3412527e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:32.586193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3ea6-5acb-44a8-959f-78a3412527e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:32.586913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3ea6-5acb-44a8-959f-78a3412527e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:32.588098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3ea6-5acb-44a8-959f-78a3412527e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:32.589734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d3ea6-5acb-44a8-959f-78a3412527e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:32.596611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d3ea6-5acb-44a8-959f-78a3412527e6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:32.624987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 829/1657] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:32.627231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d741-6865-4f7a-9a5b-99e58b226b4c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:32.645370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d741-6865-4f7a-9a5b-99e58b226b4c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:32.665473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed5e03-fbb9-4b9e-af00-003cf84b0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:32.668120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5e03-fbb9-4b9e-af00-003cf84b0f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:32.670777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5e03-fbb9-4b9e-af00-003cf84b0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:32.671061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5e03-fbb9-4b9e-af00-003cf84b0f60 admin admin] PATH_INFO: `/v3/projects/b23bb1d9138e4299bf20534428b9462b/users/651a90227e8d453b901752aa9412fa8f/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:32.738553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed5e03-fbb9-4b9e-af00-003cf84b0f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23bb1d9138e4299bf20534428b9462b, user_id=651a90227e8d453b901752aa9412fa8f, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:32.741573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed5e03-fbb9-4b9e-af00-003cf84b0f60 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:32.801255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a0e3-bd0e-454f-84e1-39dbf6ebdc34 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:32.801881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a0e3-bd0e-454f-84e1-39dbf6ebdc34 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:32.802302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a0e3-bd0e-454f-84e1-39dbf6ebdc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:32.860507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 829/1658] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:32 2022] PUT /identity/v3/projects/b23bb1d9138e4299bf20534428b9462b/users/651a90227e8d453b901752aa9412fa8f/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:32.872376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba4d2-2bcb-406d-bddb-d0b8f9f44ae1 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:32.874862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba4d2-2bcb-406d-bddb-d0b8f9f44ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:32.875530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba4d2-2bcb-406d-bddb-d0b8f9f44ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:32.878081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3a64a0e3-bd0e-454f-84e1-39dbf6ebdc34 None None] MFA Rules not processed for user `8a8974607c724b8a8b273502379a52a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:32.881508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3a64a0e3-bd0e-454f-84e1-39dbf6ebdc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:32.961384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-5c1ba4d2-2bcb-406d-bddb-d0b8f9f44ae1 None None] MFA Rules not processed for user `651a90227e8d453b901752aa9412fa8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:32.962478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5c1ba4d2-2bcb-406d-bddb-d0b8f9f44ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:33.073314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 830/1659] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:33.088982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3c8a-5656-44c6-a195-7cd7e0361949 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:33.090405 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3c8a-5656-44c6-a195-7cd7e0361949 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:33.090680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3c8a-5656-44c6-a195-7cd7e0361949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:33.145206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 830/1660] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:33.149824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ba4d2-2bcb-406d-bddb-d0b8f9f44ae1 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:33.151273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:33.167529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-052e3c8a-5656-44c6-a195-7cd7e0361949 None None] MFA Rules not processed for user `8a8974607c724b8a8b273502379a52a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:33.178275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-052e3c8a-5656-44c6-a195-7cd7e0361949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:33.202252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 831/1661] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:33.212605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3c8a-5656-44c6-a195-7cd7e0361949 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:33.214888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-052e3c8a-5656-44c6-a195-7cd7e0361949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:33.354296 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ba4d2-2bcb-406d-bddb-d0b8f9f44ae1 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:33.378745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:33.382834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:33.382834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:33.382834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:33.382834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:33.404308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:33.458727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3c8a-5656-44c6-a195-7cd7e0361949 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:33.478162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79cd1a-496f-411f-80f4-5df5662fac02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:33.478822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cd1a-496f-411f-80f4-5df5662fac02 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:33.479106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cd1a-496f-411f-80f4-5df5662fac02 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:33.479392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cd1a-496f-411f-80f4-5df5662fac02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:33.495432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79cd1a-496f-411f-80f4-5df5662fac02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:33.498146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79cd1a-496f-411f-80f4-5df5662fac02 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:33.515600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 831/1662] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:33 2022] POST /identity/v3/projects => generated 373 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:33.516751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:33.523641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:33.532132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 832/1663] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:33.534422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79cd1a-496f-411f-80f4-5df5662fac02 service nova] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:33.551195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:33.562905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79cd1a-496f-411f-80f4-5df5662fac02 service nova] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:33.713510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417905a3-3630-4afa-85e8-af1415ea7cc7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:33.720347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:33.721269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:33.721868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:33.722390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] PATH_INFO: `/v3/users/c7a0a4e5e81340a6965e0ecfddcfc292` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:33.723967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a0a4e5e81340a6965e0ecfddcfc292)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:33.727440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:33.757629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d613033-018f-4b55-aafe-8d25242f23a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:33.763502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d613033-018f-4b55-aafe-8d25242f23a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:33.764184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d613033-018f-4b55-aafe-8d25242f23a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:33.764666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d613033-018f-4b55-aafe-8d25242f23a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:33.765594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d613033-018f-4b55-aafe-8d25242f23a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:33.769985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d613033-018f-4b55-aafe-8d25242f23a5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:33.948752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 833/1664] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:33 2022] POST /identity/v3/users => generated 293 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:33.950859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d613033-018f-4b55-aafe-8d25242f23a5 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:33.982744 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d613033-018f-4b55-aafe-8d25242f23a5 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:34.042068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82e57d-be3d-4a60-b889-56e9e7d1255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:34.042728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e57d-be3d-4a60-b889-56e9e7d1255c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:34.043062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e57d-be3d-4a60-b889-56e9e7d1255c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:34.043493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e57d-be3d-4a60-b889-56e9e7d1255c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:34.046562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82e57d-be3d-4a60-b889-56e9e7d1255c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:34.054667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82e57d-be3d-4a60-b889-56e9e7d1255c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:34.085048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 834/1665] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:24:34.095056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82e57d-be3d-4a60-b889-56e9e7d1255c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:34.118295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82e57d-be3d-4a60-b889-56e9e7d1255c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:34.130109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:34.130802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:34.131076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:34.131374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] PATH_INFO: `/v3/projects/7b229b6fc24d4ce6aea6961d3b04ca52/users/8a2a7103f6484cd394b6bb5ab370968d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:34.145559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a0a4e5e81340a6965e0ecfddcfc292'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:34.147161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a0a4e5e81340a6965e0ecfddcfc292'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:34.148051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a0a4e5e81340a6965e0ecfddcfc292'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:34.183035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a0a4e5e81340a6965e0ecfddcfc292'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:34.183177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b229b6fc24d4ce6aea6961d3b04ca52, user_id=8a2a7103f6484cd394b6bb5ab370968d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:34.184640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:34.258441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-89f7756e-4dce-4128-abd3-36f8e041db9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a0a4e5e81340a6965e0ecfddcfc292'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:34.269454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 835/1666] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:34 2022] PUT /identity/v3/projects/7b229b6fc24d4ce6aea6961d3b04ca52/users/8a2a7103f6484cd394b6bb5ab370968d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:34.271346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:34.276992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:34.280340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 832/1667] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:24:33 2022] DELETE /identity/v3/users/c7a0a4e5e81340a6965e0ecfddcfc292 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:34.289225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ce59-332c-4327-9261-0a922dd05e7f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:34.290075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ce59-332c-4327-9261-0a922dd05e7f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:34.291931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ce59-332c-4327-9261-0a922dd05e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:34.338085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6261ce59-332c-4327-9261-0a922dd05e7f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:34.339758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6261ce59-332c-4327-9261-0a922dd05e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:34.384230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:34.438317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90c4f-f909-466c-af52-6c8c14901916 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:34.495859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 833/1668] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:34.528549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261ce59-332c-4327-9261-0a922dd05e7f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:34.530332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6261ce59-332c-4327-9261-0a922dd05e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:34.581829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cb17e-f879-474b-9b32-ce425d57ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:34.581969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb17e-f879-474b-9b32-ce425d57ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:34.582259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb17e-f879-474b-9b32-ce425d57ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:34.582532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb17e-f879-474b-9b32-ce425d57ae1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:34.583288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cb17e-f879-474b-9b32-ce425d57ae1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:34.584846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cb17e-f879-474b-9b32-ce425d57ae1e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:34.600904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:34.603615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 836/1669] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:34.613023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cb17e-f879-474b-9b32-ce425d57ae1e admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:34.625538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cb17e-f879-474b-9b32-ce425d57ae1e admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:34.635724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11933970-8edf-494e-b770-8c42d169a4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:34.637140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11933970-8edf-494e-b770-8c42d169a4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:34.637917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11933970-8edf-494e-b770-8c42d169a4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:34.639090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11933970-8edf-494e-b770-8c42d169a4c0 admin admin] PATH_INFO: `/v3/projects/7b229b6fc24d4ce6aea6961d3b04ca52/users/8a2a7103f6484cd394b6bb5ab370968d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:34.643663 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11933970-8edf-494e-b770-8c42d169a4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b229b6fc24d4ce6aea6961d3b04ca52, user_id=8a2a7103f6484cd394b6bb5ab370968d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:34.647404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11933970-8edf-494e-b770-8c42d169a4c0 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:34.655685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261ce59-332c-4327-9261-0a922dd05e7f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:34.680426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 837/1670] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:34 2022] PUT /identity/v3/projects/7b229b6fc24d4ce6aea6961d3b04ca52/users/8a2a7103f6484cd394b6bb5ab370968d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:34.693619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189b1e-a6af-40fe-83e8-ec48e31c3ceb None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:34.694496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189b1e-a6af-40fe-83e8-ec48e31c3ceb None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:34.695151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34189b1e-a6af-40fe-83e8-ec48e31c3ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:34.761193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-34189b1e-a6af-40fe-83e8-ec48e31c3ceb None None] MFA Rules not processed for user `8a2a7103f6484cd394b6bb5ab370968d`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:34.763795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-34189b1e-a6af-40fe-83e8-ec48e31c3ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:34.775731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534b793-21dd-4c89-929a-f12c15197583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:34.776480 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b793-21dd-4c89-929a-f12c15197583 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:34.776804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b793-21dd-4c89-929a-f12c15197583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:34.777315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b793-21dd-4c89-929a-f12c15197583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:34.928568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 838/1671] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:34.944686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34189b1e-a6af-40fe-83e8-ec48e31c3ceb None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:34.944686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-34189b1e-a6af-40fe-83e8-ec48e31c3ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:34.958786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534b793-21dd-4c89-929a-f12c15197583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:34.960335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534b793-21dd-4c89-929a-f12c15197583 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:34.986892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 834/1672] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:24:35.060510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34189b1e-a6af-40fe-83e8-ec48e31c3ceb None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:35.076535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203d36-cc5b-4894-ab74-8cc6a7f5218a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:35.077423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203d36-cc5b-4894-ab74-8cc6a7f5218a service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:35.077864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203d36-cc5b-4894-ab74-8cc6a7f5218a service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:35.078280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203d36-cc5b-4894-ab74-8cc6a7f5218a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:35.094666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8203d36-cc5b-4894-ab74-8cc6a7f5218a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:35.096602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8203d36-cc5b-4894-ab74-8cc6a7f5218a service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:35.101454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:35.121611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 839/1673] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:35.224810 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b56c-4cc9-4872-9bc6-765defab4c40 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:35.225412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b56c-4cc9-4872-9bc6-765defab4c40 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:35.225412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b56c-4cc9-4872-9bc6-765defab4c40 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:35.230301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 835/1674] 10.222.0.93 () {54 vars in 912 bytes} [Thu Aug 4 21:24:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:24:35.238100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e021bb-b5cd-4490-8f7a-1d7e92c4d58b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:35.243711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e021bb-b5cd-4490-8f7a-1d7e92c4d58b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:35.243711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e021bb-b5cd-4490-8f7a-1d7e92c4d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:35.314478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-50e021bb-b5cd-4490-8f7a-1d7e92c4d58b None None] MFA Rules not processed for user `a67b35a2567941f59dd746a3813b9d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:35.316202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-50e021bb-b5cd-4490-8f7a-1d7e92c4d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:35.332248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 840/1675] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:35.357222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9b56c-4cc9-4872-9bc6-765defab4c40 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:35.413889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9b56c-4cc9-4872-9bc6-765defab4c40 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:35.443493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f52308-8a37-4652-b14e-72ee17b01f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:35.450733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52308-8a37-4652-b14e-72ee17b01f01 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:35.450733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52308-8a37-4652-b14e-72ee17b01f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:35.450733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52308-8a37-4652-b14e-72ee17b01f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:35.461981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52308-8a37-4652-b14e-72ee17b01f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:35.467503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52308-8a37-4652-b14e-72ee17b01f01 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:35.492363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 836/1676] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:36.711351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e021bb-b5cd-4490-8f7a-1d7e92c4d58b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:36.737547 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e021bb-b5cd-4490-8f7a-1d7e92c4d58b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:36.764696 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:36.765499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:36.765780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:36.766060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] PATH_INFO: `/v3/users/651a90227e8d453b901752aa9412fa8f` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:36.767536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=651a90227e8d453b901752aa9412fa8f)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:36.769589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:37.090517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651a90227e8d453b901752aa9412fa8f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:37.119886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651a90227e8d453b901752aa9412fa8f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:37.245373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651a90227e8d453b901752aa9412fa8f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:37.300871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651a90227e8d453b901752aa9412fa8f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:37.302693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b273b2b5-1cea-4075-ba30-1e91cad55baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651a90227e8d453b901752aa9412fa8f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:37.366191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 841/1677] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:24:36 2022] DELETE /identity/v3/users/651a90227e8d453b901752aa9412fa8f => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:37.368320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fcb0-ce21-4b51-8851-7388d831b08a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:37.368320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fcb0-ce21-4b51-8851-7388d831b08a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:37.368320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fcb0-ce21-4b51-8851-7388d831b08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:37.429555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cae6fcb0-ce21-4b51-8851-7388d831b08a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:37.437747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cae6fcb0-ce21-4b51-8851-7388d831b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:37.688642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124942dd-82b6-4498-b5d2-e1dc29303913 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:37.694698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124942dd-82b6-4498-b5d2-e1dc29303913 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:37.695132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124942dd-82b6-4498-b5d2-e1dc29303913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:37.703968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 837/1678] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:37.715781 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6fcb0-ce21-4b51-8851-7388d831b08a None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:37.718270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cae6fcb0-ce21-4b51-8851-7388d831b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:37.787114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-124942dd-82b6-4498-b5d2-e1dc29303913 None None] MFA Rules not processed for user `06323c8fcf99441f9f87db199e93c8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:37.788446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-124942dd-82b6-4498-b5d2-e1dc29303913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:37.797658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:37.899413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6fcb0-ce21-4b51-8851-7388d831b08a None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:37.913227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:37.914502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:37.914502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:37.914502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:37.934553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:37.937742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:37.976542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 838/1679] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:24:37.977604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:37.979251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:38.035970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3d22b-f2fc-4f55-bf2e-a6cf97415065 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:38.065119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:38.066234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:38.066234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:38.066425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] PATH_INFO: `/v3/projects/5a2c550e65c648ef8855e97c7e1ee540` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:38.071054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2c550e65c648ef8855e97c7e1ee540)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:38.073313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:38.102481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 842/1680] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:38.123139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124942dd-82b6-4498-b5d2-e1dc29303913 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:38.124618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-124942dd-82b6-4498-b5d2-e1dc29303913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:38.360694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:38.390317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2c550e65c648ef8855e97c7e1ee540', 'request_id': 'req-f000a458-175c-46d1-8e98-2885ce92f1b9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:38.425653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2c550e65c648ef8855e97c7e1ee540', 'request_id': 'req-f000a458-175c-46d1-8e98-2885ce92f1b9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:38.456624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124942dd-82b6-4498-b5d2-e1dc29303913 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:38.675442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2c550e65c648ef8855e97c7e1ee540', 'request_id': 'req-f000a458-175c-46d1-8e98-2885ce92f1b9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:38.702858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] The token cache is being invalidate because project 5a2c550e65c648ef8855e97c7e1ee540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:24:38.703485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:38.705330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2160a08-5a31-4f21-9fcb-a1896fa23ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:38.705832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f000a458-175c-46d1-8e98-2885ce92f1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:38.711836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 839/1681] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:24:37 2022] DELETE /identity/v3/projects/5a2c550e65c648ef8855e97c7e1ee540 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:38.713691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad635171-d944-4baf-9301-03765d1a0333 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:38.718786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160a08-5a31-4f21-9fcb-a1896fa23ab5 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:38.718930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad635171-d944-4baf-9301-03765d1a0333 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:38.719012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160a08-5a31-4f21-9fcb-a1896fa23ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:38.719087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad635171-d944-4baf-9301-03765d1a0333 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:38.719159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160a08-5a31-4f21-9fcb-a1896fa23ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:38.728845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c2160a08-5a31-4f21-9fcb-a1896fa23ab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:38.744972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 840/1682] 10.222.0.93 () {54 vars in 961 bytes} [Thu Aug 4 21:24:38 2022] GET /identity => generated 270 bytes in 32 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:24:38.746700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df973-68ca-4063-8805-186ec17b4848 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:38.752140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df973-68ca-4063-8805-186ec17b4848 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:38.754832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df973-68ca-4063-8805-186ec17b4848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:38.830101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-5b9df973-68ca-4063-8805-186ec17b4848 None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:38.831670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5b9df973-68ca-4063-8805-186ec17b4848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:39.001765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2160a08-5a31-4f21-9fcb-a1896fa23ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:39.003445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2160a08-5a31-4f21-9fcb-a1896fa23ab5 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:39.059061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 841/1683] 10.222.0.93 () {58 vars in 1058 bytes} [Thu Aug 4 21:24:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:39.067432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccec5-6858-463b-86bb-41bcdc04fcc5 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:39.067721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccec5-6858-463b-86bb-41bcdc04fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:39.071261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccec5-6858-463b-86bb-41bcdc04fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:39.074308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 843/1684] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 952 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:39.080198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b388a-3918-4d60-b1ba-a4dfa8dc6d32 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:39.080478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b388a-3918-4d60-b1ba-a4dfa8dc6d32 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:39.080765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b388a-3918-4d60-b1ba-a4dfa8dc6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:39.141023 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-056ccec5-6858-463b-86bb-41bcdc04fcc5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:39.141023 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-056ccec5-6858-463b-86bb-41bcdc04fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:39.152947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-325b388a-3918-4d60-b1ba-a4dfa8dc6d32 None None] MFA Rules not processed for user `8a8974607c724b8a8b273502379a52a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:39.155284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-325b388a-3918-4d60-b1ba-a4dfa8dc6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:39.270389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:39.308218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 844/1685] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:39.309382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b388a-3918-4d60-b1ba-a4dfa8dc6d32 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:39.347861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 842/1686] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:39.367247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3f17-16d7-4cd1-90d1-75c2c04905a6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:39.367538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3f17-16d7-4cd1-90d1-75c2c04905a6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:39.371418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3f17-16d7-4cd1-90d1-75c2c04905a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:39.377924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b388a-3918-4d60-b1ba-a4dfa8dc6d32 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:39.405640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:39.406686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:39.406686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:39.408683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:39.415747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:39.447721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1bab3f17-16d7-4cd1-90d1-75c2c04905a6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:39.451145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1bab3f17-16d7-4cd1-90d1-75c2c04905a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:39.458974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:39.468328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:39.489454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 843/1687] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:39.490397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3f17-16d7-4cd1-90d1-75c2c04905a6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:39.506705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 845/1688] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:39.512687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3f17-16d7-4cd1-90d1-75c2c04905a6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:39.526012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec23baa-7b07-4b80-984c-250653a8626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:39.526807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec23baa-7b07-4b80-984c-250653a8626a admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:39.527390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec23baa-7b07-4b80-984c-250653a8626a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:39.527813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec23baa-7b07-4b80-984c-250653a8626a admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:39.529243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec23baa-7b07-4b80-984c-250653a8626a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:39.529726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec23baa-7b07-4b80-984c-250653a8626a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:39.532262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec23baa-7b07-4b80-984c-250653a8626a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:39.559707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:39.571347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 844/1689] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:39.573981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097717-5980-49bf-b59c-4d62c2419672 service placement] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:39.621155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b607d-25a8-479d-860e-49e09b698616 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:39.621638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b607d-25a8-479d-860e-49e09b698616 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:39.622228 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b607d-25a8-479d-860e-49e09b698616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:39.625379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:39.626177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:39.626497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:39.626861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:39.627486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:39.712057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:39.779972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-bd4b607d-25a8-479d-860e-49e09b698616 None None] MFA Rules not processed for user `793d3d46e32b4550b711841f2447461a`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:39.794983 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bd4b607d-25a8-479d-860e-49e09b698616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:39.856531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 846/1690] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:39 2022] POST /identity/v3/projects => generated 387 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:39.859078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:39.867726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:40.012318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 845/1691] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:40.014695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b607d-25a8-479d-860e-49e09b698616 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:40.032229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b607d-25a8-479d-860e-49e09b698616 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:40.137610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e0f60-9848-4cb7-b90e-e47417fb1e7a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:40.146783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:40.146783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:40.146783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:40.146783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] PATH_INFO: `/v3/projects/b23bb1d9138e4299bf20534428b9462b` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:40.147466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23bb1d9138e4299bf20534428b9462b)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:40.150262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:40.193330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:40.193985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:40.194260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:40.194539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:40.195214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:40.198415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:40.364824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 846/1692] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:40 2022] POST /identity/v3/users => generated 294 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:40.364824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:40.368679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23bb1d9138e4299bf20534428b9462b', 'request_id': 'req-3b572350-15c4-409b-a1a0-46f5efbf4213'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:40.373134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:40.380087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23bb1d9138e4299bf20534428b9462b', 'request_id': 'req-3b572350-15c4-409b-a1a0-46f5efbf4213'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:40.521519 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23bb1d9138e4299bf20534428b9462b', 'request_id': 'req-3b572350-15c4-409b-a1a0-46f5efbf4213'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:40.526133 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175df1-e554-416c-bdae-c9009a5ccc18 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:40.541132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] The token cache is being invalidate because project b23bb1d9138e4299bf20534428b9462b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:24:40.541690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:40.542594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:40.547563 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 847/1693] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:24:39 2022] DELETE /identity/v3/projects/b23bb1d9138e4299bf20534428b9462b => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:40.549118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:40.552809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:40.652780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:40.654132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:40.654796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:40.655384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:40.658232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:40.667565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b572350-15c4-409b-a1a0-46f5efbf4213 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:40.676934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:40.677761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:40.678051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:40.678340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:40.679360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:40.681215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:40.703786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 848/1694] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:40.704553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:40.706514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:40.721917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df081b-51a1-4d80-bf75-1fe403b7b686 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:40.727641 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:40.729204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:40.729587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:40.729771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] PATH_INFO: `/v3/users/8a2a7103f6484cd394b6bb5ab370968d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:40.731396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2a7103f6484cd394b6bb5ab370968d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:40.733834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:40.804818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:40.807651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:40.808360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:40.821606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 847/1695] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:40.822523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:40.834002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137c94-02b6-46db-9d5b-a3fd6225f561 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:40.861864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43447-c8db-40b9-869c-789d3ed54f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:40.861864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43447-c8db-40b9-869c-789d3ed54f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:40.861864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43447-c8db-40b9-869c-789d3ed54f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:40.861864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43447-c8db-40b9-869c-789d3ed54f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:40.863468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43447-c8db-40b9-869c-789d3ed54f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:40.863468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43447-c8db-40b9-869c-789d3ed54f36 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:40.863468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 848/1696] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:40.865990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43447-c8db-40b9-869c-789d3ed54f36 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:40.882889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43447-c8db-40b9-869c-789d3ed54f36 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:40.889869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eddf7c-f907-4206-ac5d-95394a92ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:40.890769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eddf7c-f907-4206-ac5d-95394a92ca47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:40.891115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eddf7c-f907-4206-ac5d-95394a92ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:40.891422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eddf7c-f907-4206-ac5d-95394a92ca47 admin admin] PATH_INFO: `/v3/projects/5801e3aab4f448b38672c87cceb991dd/users/e264d06c1a8f45f4b94ebba1867233e7/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:40.926004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eddf7c-f907-4206-ac5d-95394a92ca47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5801e3aab4f448b38672c87cceb991dd, user_id=e264d06c1a8f45f4b94ebba1867233e7, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:40.928798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eddf7c-f907-4206-ac5d-95394a92ca47 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:41.071327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 849/1697] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:40 2022] PUT /identity/v3/projects/5801e3aab4f448b38672c87cceb991dd/users/e264d06c1a8f45f4b94ebba1867233e7/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:24:41.083866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05ba3-0bfa-47a4-b9dd-34e638da3b89 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:41.084147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05ba3-0bfa-47a4-b9dd-34e638da3b89 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:41.084422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05ba3-0bfa-47a4-b9dd-34e638da3b89 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:41.087075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 850/1698] 10.222.0.93 () {54 vars in 912 bytes} [Thu Aug 4 21:24:41 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:24:41.093683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e748-1852-4fa4-8dd7-3fece6d02b20 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:41.093993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e748-1852-4fa4-8dd7-3fece6d02b20 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:41.094272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e748-1852-4fa4-8dd7-3fece6d02b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:41.127598 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2a7103f6484cd394b6bb5ab370968d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:41.158309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2a7103f6484cd394b6bb5ab370968d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:41.190977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-07d7e748-1852-4fa4-8dd7-3fece6d02b20 None None] MFA Rules not processed for user `e264d06c1a8f45f4b94ebba1867233e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:41.195097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-07d7e748-1852-4fa4-8dd7-3fece6d02b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:41.261092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2a7103f6484cd394b6bb5ab370968d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:41.286400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2a7103f6484cd394b6bb5ab370968d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:41.287801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5023cb5-fbc5-425a-abaf-31f735e0ae21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2a7103f6484cd394b6bb5ab370968d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:41.310591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 849/1699] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:24:40 2022] DELETE /identity/v3/users/8a2a7103f6484cd394b6bb5ab370968d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:41.312099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166a2d-fe61-4649-899f-fb8712a8e185 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:41.312377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166a2d-fe61-4649-899f-fb8712a8e185 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:41.312667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166a2d-fe61-4649-899f-fb8712a8e185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:41.326725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 851/1700] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:41.329691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244de29c-3048-489e-8c36-1f3028e2433e None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:41.331241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244de29c-3048-489e-8c36-1f3028e2433e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:41.331958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244de29c-3048-489e-8c36-1f3028e2433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:41.390751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-25166a2d-fe61-4649-899f-fb8712a8e185 None None] MFA Rules not processed for user `a67b35a2567941f59dd746a3813b9d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:41.392325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-25166a2d-fe61-4649-899f-fb8712a8e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:41.414365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-244de29c-3048-489e-8c36-1f3028e2433e None None] MFA Rules not processed for user `e6e5d240443d4a148346bf9f1270b1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:41.421246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-244de29c-3048-489e-8c36-1f3028e2433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:41.565913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 850/1701] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:24:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:41.566881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166a2d-fe61-4649-899f-fb8712a8e185 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:41.569695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-25166a2d-fe61-4649-899f-fb8712a8e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:41.692223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 852/1702] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:41.711894 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244de29c-3048-489e-8c36-1f3028e2433e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:41.713542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-244de29c-3048-489e-8c36-1f3028e2433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:41.788759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166a2d-fe61-4649-899f-fb8712a8e185 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:41.806935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:41.808235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:41.808826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:41.809366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:41.810815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:41.813065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:41.975447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:41.985610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 851/1703] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:41 2022] POST /identity/v3/projects => generated 387 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:41.988560 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:41.995950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:42.071114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:42.127348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244de29c-3048-489e-8c36-1f3028e2433e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:42.335481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf2286-d063-4d31-a90e-20d7e3ae79b4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:42.343311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafd08b-1337-4900-868f-74c77f182c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:42.344323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafd08b-1337-4900-868f-74c77f182c98 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:42.345541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafd08b-1337-4900-868f-74c77f182c98 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:42.346051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafd08b-1337-4900-868f-74c77f182c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:42.346296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb4b1-0360-4c78-935a-c26f848900c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:42.348212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb4b1-0360-4c78-935a-c26f848900c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:42.348529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb4b1-0360-4c78-935a-c26f848900c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:42.355078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb4b1-0360-4c78-935a-c26f848900c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:42.410922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb4b1-0360-4c78-935a-c26f848900c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:42.417940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb4b1-0360-4c78-935a-c26f848900c0 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:42.457009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 852/1704] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:42.459889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb4b1-0360-4c78-935a-c26f848900c0 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:42.682062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafd08b-1337-4900-868f-74c77f182c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:42.689463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafd08b-1337-4900-868f-74c77f182c98 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:42.759583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 853/1705] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1047 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:24:42.812371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb4b1-0360-4c78-935a-c26f848900c0 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:42.839850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d8c4c-2cf6-4ff5-8813-d4125542b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:42.850860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d8c4c-2cf6-4ff5-8813-d4125542b03a admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:42.851664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d8c4c-2cf6-4ff5-8813-d4125542b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:42.853390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d8c4c-2cf6-4ff5-8813-d4125542b03a admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:42.854588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d8c4c-2cf6-4ff5-8813-d4125542b03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:42.859038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d8c4c-2cf6-4ff5-8813-d4125542b03a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:43.132020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 853/1706] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:42 2022] POST /identity/v3/users => generated 294 bytes in 675 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:43.135889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafd08b-1337-4900-868f-74c77f182c98 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:43.165261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafd08b-1337-4900-868f-74c77f182c98 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:43.179011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc40d-bec1-41fa-b4d2-591b9ea419d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:43.179662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc40d-bec1-41fa-b4d2-591b9ea419d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:43.179939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc40d-bec1-41fa-b4d2-591b9ea419d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:43.180207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc40d-bec1-41fa-b4d2-591b9ea419d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:43.180968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc40d-bec1-41fa-b4d2-591b9ea419d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:43.182632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc40d-bec1-41fa-b4d2-591b9ea419d2 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:43.212533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d8c4c-2cf6-4ff5-8813-d4125542b03a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:43.212857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 854/1707] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:43.229932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d8c4c-2cf6-4ff5-8813-d4125542b03a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:43.245183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e4057-e20c-419a-a96b-13c860966db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:43.245183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e4057-e20c-419a-a96b-13c860966db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:43.245183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e4057-e20c-419a-a96b-13c860966db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:43.245183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e4057-e20c-419a-a96b-13c860966db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:43.245915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e4057-e20c-419a-a96b-13c860966db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:43.245915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e4057-e20c-419a-a96b-13c860966db7 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:43.277025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc40d-bec1-41fa-b4d2-591b9ea419d2 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:43.287682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 854/1708] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:43.297415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc40d-bec1-41fa-b4d2-591b9ea419d2 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:43.308977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f0d1a-3042-4ba2-8cfd-4ef1e5f1e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:43.312277 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0d1a-3042-4ba2-8cfd-4ef1e5f1e5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:43.313640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0d1a-3042-4ba2-8cfd-4ef1e5f1e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:43.313927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0d1a-3042-4ba2-8cfd-4ef1e5f1e5cf admin admin] PATH_INFO: `/v3/projects/6dde9d7808964f59bd684347adb9316e/users/aea766a21ac0488d806f8facb2d58a62/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:43.385244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:43.388635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f0d1a-3042-4ba2-8cfd-4ef1e5f1e5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dde9d7808964f59bd684347adb9316e, user_id=aea766a21ac0488d806f8facb2d58a62, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:43.391964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f0d1a-3042-4ba2-8cfd-4ef1e5f1e5cf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:43.481842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 855/1709] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:43 2022] PUT /identity/v3/projects/6dde9d7808964f59bd684347adb9316e/users/aea766a21ac0488d806f8facb2d58a62/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:43.492647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef402f-42b6-4f62-969e-e72412ecb7e0 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:43.493603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef402f-42b6-4f62-969e-e72412ecb7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:43.494206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef402f-42b6-4f62-969e-e72412ecb7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:43.563545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b1ef402f-42b6-4f62-969e-e72412ecb7e0 None None] MFA Rules not processed for user `aea766a21ac0488d806f8facb2d58a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:43.565983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b1ef402f-42b6-4f62-969e-e72412ecb7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:43.677806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebd813-40aa-402b-95fa-00368f6cd806 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:43.678054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebd813-40aa-402b-95fa-00368f6cd806 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:43.678325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebd813-40aa-402b-95fa-00368f6cd806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:43.725296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 855/1710] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:43.729569 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef402f-42b6-4f62-969e-e72412ecb7e0 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:43.737635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f4ebd813-40aa-402b-95fa-00368f6cd806 None None] MFA Rules not processed for user `08c83e5f57c341918a74006d47a4249d`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:43.743291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f4ebd813-40aa-402b-95fa-00368f6cd806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:43.836554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef402f-42b6-4f62-969e-e72412ecb7e0 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:43.845466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75ca6d-d6b8-467f-b03a-5ff8d30c577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:43.850736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75ca6d-d6b8-467f-b03a-5ff8d30c577d admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:43.850736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75ca6d-d6b8-467f-b03a-5ff8d30c577d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:43.850736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75ca6d-d6b8-467f-b03a-5ff8d30c577d admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:43.850736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75ca6d-d6b8-467f-b03a-5ff8d30c577d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:43.850736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75ca6d-d6b8-467f-b03a-5ff8d30c577d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:43.886902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 856/1711] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:43.899584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376745-e0ac-4e26-a5d6-47de26433a5d None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:43.900316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376745-e0ac-4e26-a5d6-47de26433a5d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:43.900733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376745-e0ac-4e26-a5d6-47de26433a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:44.023369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 856/1712] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:43 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:44.027614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75ca6d-d6b8-467f-b03a-5ff8d30c577d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:44.036156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-62376745-e0ac-4e26-a5d6-47de26433a5d None None] MFA Rules not processed for user `08c83e5f57c341918a74006d47a4249d`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:44.040657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-62376745-e0ac-4e26-a5d6-47de26433a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:44.156052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 857/1713] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:44.190424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:44.192145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376745-e0ac-4e26-a5d6-47de26433a5d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:44.205632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75ca6d-d6b8-467f-b03a-5ff8d30c577d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:44.220132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:44.220846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:44.221163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:44.221487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:44.222378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:44.227192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:44.369771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 857/1714] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:44 2022] POST /identity/v3/users => generated 299 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:24:44.369771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:44.370992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:44.417628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c63d04-cf8c-4789-97de-529306c43a2a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:44.441617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:44.441996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:44.442331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:44.442461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] PATH_INFO: `/v3/projects/7b229b6fc24d4ce6aea6961d3b04ca52` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:44.444160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b229b6fc24d4ce6aea6961d3b04ca52)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:44.449048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:44.468194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376745-e0ac-4e26-a5d6-47de26433a5d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:44.483930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4751ea4-5c4d-417a-a52b-83483aab742a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:44.484581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4751ea4-5c4d-417a-a52b-83483aab742a service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:44.484858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4751ea4-5c4d-417a-a52b-83483aab742a service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:44.485191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4751ea4-5c4d-417a-a52b-83483aab742a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:44.518493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4751ea4-5c4d-417a-a52b-83483aab742a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:44.521776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4751ea4-5c4d-417a-a52b-83483aab742a service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:44.565955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 858/1715] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:44.567126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4751ea4-5c4d-417a-a52b-83483aab742a service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:44.605256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4751ea4-5c4d-417a-a52b-83483aab742a service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:44.620548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7a3f5-e03a-46d3-8434-84d650bc26bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:44.621457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a3f5-e03a-46d3-8434-84d650bc26bd admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:44.621918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a3f5-e03a-46d3-8434-84d650bc26bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:44.624581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7a3f5-e03a-46d3-8434-84d650bc26bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:44.625625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7a3f5-e03a-46d3-8434-84d650bc26bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:44.628421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7a3f5-e03a-46d3-8434-84d650bc26bd admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:44.659609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b229b6fc24d4ce6aea6961d3b04ca52', 'request_id': 'req-5aec84bb-5464-403c-a78e-f706ae9adbbb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:44.661310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 859/1716] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:44.666270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7a3f5-e03a-46d3-8434-84d650bc26bd admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:44.691472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7a3f5-e03a-46d3-8434-84d650bc26bd admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:44.710776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b229b6fc24d4ce6aea6961d3b04ca52', 'request_id': 'req-5aec84bb-5464-403c-a78e-f706ae9adbbb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:44.868171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9925aa-7407-4be1-b700-a47164752f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:44.868858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9925aa-7407-4be1-b700-a47164752f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:44.869207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9925aa-7407-4be1-b700-a47164752f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:44.869483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9925aa-7407-4be1-b700-a47164752f9e admin admin] PATH_INFO: `/v3/projects/1e225dd11d874817ad1dd515823e2aa8/users/7bb0e627693d455982408a36acfe7a00/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:44.885404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b229b6fc24d4ce6aea6961d3b04ca52', 'request_id': 'req-5aec84bb-5464-403c-a78e-f706ae9adbbb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:44.895269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9925aa-7407-4be1-b700-a47164752f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e225dd11d874817ad1dd515823e2aa8, user_id=7bb0e627693d455982408a36acfe7a00, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:44.904832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] The token cache is being invalidate because project 7b229b6fc24d4ce6aea6961d3b04ca52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:24:44.907042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9925aa-7407-4be1-b700-a47164752f9e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:44.907199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:44.908970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5aec84bb-5464-403c-a78e-f706ae9adbbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:44.928068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 858/1717] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:24:44 2022] DELETE /identity/v3/projects/7b229b6fc24d4ce6aea6961d3b04ca52 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:44.929337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d04ac-d0c2-4cf4-8d5b-5442e30214d7 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:44.929643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d04ac-d0c2-4cf4-8d5b-5442e30214d7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:44.929926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d04ac-d0c2-4cf4-8d5b-5442e30214d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:45.001826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3a5d04ac-d0c2-4cf4-8d5b-5442e30214d7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:45.009481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3a5d04ac-d0c2-4cf4-8d5b-5442e30214d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:45.038522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 859/1718] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:45.043692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 860/1719] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:44 2022] PUT /identity/v3/projects/1e225dd11d874817ad1dd515823e2aa8/users/7bb0e627693d455982408a36acfe7a00/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:45.053785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d04ac-d0c2-4cf4-8d5b-5442e30214d7 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:45.055252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3a5d04ac-d0c2-4cf4-8d5b-5442e30214d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:45.058375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd2d1-811a-4753-9536-e0e6f830c794 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:45.058761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd2d1-811a-4753-9536-e0e6f830c794 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:45.059093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd2d1-811a-4753-9536-e0e6f830c794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:45.082195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d04ac-d0c2-4cf4-8d5b-5442e30214d7 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:45.086786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cd0dd2d1-811a-4753-9536-e0e6f830c794 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:45.086786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cd0dd2d1-811a-4753-9536-e0e6f830c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:45.159088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 861/1720] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:45.164539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dd2d1-811a-4753-9536-e0e6f830c794 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:45.192335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dd2d1-811a-4753-9536-e0e6f830c794 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:45.211501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:45.226233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:45.226233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:45.226463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:45.227012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:24:45.227386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:45.228987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:45.262705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc082bab-9470-48f5-b9e3-b78afef03c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:45.262705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc082bab-9470-48f5-b9e3-b78afef03c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:45.262705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc082bab-9470-48f5-b9e3-b78afef03c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:45.262705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc082bab-9470-48f5-b9e3-b78afef03c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:45.263385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc082bab-9470-48f5-b9e3-b78afef03c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:45.263385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc082bab-9470-48f5-b9e3-b78afef03c68 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:45.271375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 862/1721] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:24:45.276385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:45.294957 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 860/1722] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:45.295156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:45.297863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc082bab-9470-48f5-b9e3-b78afef03c68 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:45.303991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb274a3b-5098-4627-acfd-12cda34f976e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:45.318228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc082bab-9470-48f5-b9e3-b78afef03c68 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:45.325272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f71e-d81b-40e6-b6e8-c672a8d17c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:45.326324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f71e-d81b-40e6-b6e8-c672a8d17c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:45.326614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f71e-d81b-40e6-b6e8-c672a8d17c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:45.326904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f71e-d81b-40e6-b6e8-c672a8d17c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:45.327574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f71e-d81b-40e6-b6e8-c672a8d17c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:45.329344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4463b-8a43-41f6-8f18-16bce0c58df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:45.330041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4463b-8a43-41f6-8f18-16bce0c58df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:45.330317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4463b-8a43-41f6-8f18-16bce0c58df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:45.330589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4463b-8a43-41f6-8f18-16bce0c58df1 admin admin] PATH_INFO: `/v3/projects/1e225dd11d874817ad1dd515823e2aa8/users/7bb0e627693d455982408a36acfe7a00/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:45.334319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4463b-8a43-41f6-8f18-16bce0c58df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e225dd11d874817ad1dd515823e2aa8, user_id=7bb0e627693d455982408a36acfe7a00, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:45.334900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f71e-d81b-40e6-b6e8-c672a8d17c7c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:45.337065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4463b-8a43-41f6-8f18-16bce0c58df1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:45.364934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 861/1723] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:45 2022] PUT /identity/v3/projects/1e225dd11d874817ad1dd515823e2aa8/users/7bb0e627693d455982408a36acfe7a00/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:45.374897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d987-fd2b-4006-86e4-e64119a068e7 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:45.377540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d987-fd2b-4006-86e4-e64119a068e7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:45.377540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d987-fd2b-4006-86e4-e64119a068e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:45.431736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-5866d987-fd2b-4006-86e4-e64119a068e7 None None] MFA Rules not processed for user `7bb0e627693d455982408a36acfe7a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:45.438015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5866d987-fd2b-4006-86e4-e64119a068e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:45.483953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 863/1724] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:45 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:45.488242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f71e-d81b-40e6-b6e8-c672a8d17c7c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:45.598765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 862/1725] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:45.607314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d987-fd2b-4006-86e4-e64119a068e7 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:45.612605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5866d987-fd2b-4006-86e4-e64119a068e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:45.675095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f71e-d81b-40e6-b6e8-c672a8d17c7c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:45.692127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8c58d-7835-404d-813e-a84f202024b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:45.692854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c58d-7835-404d-813e-a84f202024b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:45.693232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c58d-7835-404d-813e-a84f202024b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:45.693579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c58d-7835-404d-813e-a84f202024b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:45.694359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8c58d-7835-404d-813e-a84f202024b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:45.696527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8c58d-7835-404d-813e-a84f202024b8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:45.835391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d987-fd2b-4006-86e4-e64119a068e7 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:45.902554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 864/1726] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:45 2022] POST /identity/v3/users => generated 285 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:24:45.906490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4e352-c0e7-4fa4-a7b3-d2c32234d3cb None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:45.910321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4e352-c0e7-4fa4-a7b3-d2c32234d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:45.910925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4e352-c0e7-4fa4-a7b3-d2c32234d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:46.052706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8b80-0fbd-4062-ba56-0b0e9fc7f651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:46.054100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8b80-0fbd-4062-ba56-0b0e9fc7f651 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:46.054456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8b80-0fbd-4062-ba56-0b0e9fc7f651 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:46.055224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8b80-0fbd-4062-ba56-0b0e9fc7f651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:46.091962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-aac4e352-c0e7-4fa4-a7b3-d2c32234d3cb None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:46.104965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-aac4e352-c0e7-4fa4-a7b3-d2c32234d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:46.179186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:46.283915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8b80-0fbd-4062-ba56-0b0e9fc7f651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:46.286527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8b80-0fbd-4062-ba56-0b0e9fc7f651 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:46.343573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 863/1727] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:24:46.344123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8b80-0fbd-4062-ba56-0b0e9fc7f651 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:46.345015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 865/1728] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:46.346716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042f7b-0571-48df-b30b-cdce9760ddeb None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:46.353398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042f7b-0571-48df-b30b-cdce9760ddeb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:46.355101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042f7b-0571-48df-b30b-cdce9760ddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:46.378750 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8b80-0fbd-4062-ba56-0b0e9fc7f651 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:46.392962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84e738-6a69-4fbd-9c1b-0cfce088af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:46.393886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84e738-6a69-4fbd-9c1b-0cfce088af88 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:46.394450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84e738-6a69-4fbd-9c1b-0cfce088af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:46.394907 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84e738-6a69-4fbd-9c1b-0cfce088af88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:46.397249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84e738-6a69-4fbd-9c1b-0cfce088af88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:46.399188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84e738-6a69-4fbd-9c1b-0cfce088af88 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:46.410138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-8a042f7b-0571-48df-b30b-cdce9760ddeb None None] MFA Rules not processed for user `06323c8fcf99441f9f87db199e93c8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:46.412702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8a042f7b-0571-48df-b30b-cdce9760ddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:46.433728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 864/1729] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:46.436373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84e738-6a69-4fbd-9c1b-0cfce088af88 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:46.471698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84e738-6a69-4fbd-9c1b-0cfce088af88 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:46.501215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43704bf1-169c-45c0-8cf4-6647d782c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:46.505823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704bf1-169c-45c0-8cf4-6647d782c36f admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:46.505957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 866/1730] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:46.512241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704bf1-169c-45c0-8cf4-6647d782c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:46.513650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704bf1-169c-45c0-8cf4-6647d782c36f admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:46.514544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43704bf1-169c-45c0-8cf4-6647d782c36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:46.518727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43704bf1-169c-45c0-8cf4-6647d782c36f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:46.556784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 865/1731] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:46.559300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a042f7b-0571-48df-b30b-cdce9760ddeb None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:46.593069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a042f7b-0571-48df-b30b-cdce9760ddeb None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:46.607905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:46.608947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:46.608947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:46.609161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] PATH_INFO: `/v3/projects/a0ed5d24e7f14b0885db84cd6a889cdb/users/f538ac5520f04f7aac59aac405a3fea9/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:46.644266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ed5d24e7f14b0885db84cd6a889cdb, user_id=f538ac5520f04f7aac59aac405a3fea9, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:46.650375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:46.800047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 867/1732] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:46 2022] PUT /identity/v3/projects/a0ed5d24e7f14b0885db84cd6a889cdb/users/f538ac5520f04f7aac59aac405a3fea9/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:46.835956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc726270-9d4b-4ea6-9b5f-bf2f0ccbfcf8 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:46.837135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc726270-9d4b-4ea6-9b5f-bf2f0ccbfcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:46.838037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc726270-9d4b-4ea6-9b5f-bf2f0ccbfcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:46.945826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-dc726270-9d4b-4ea6-9b5f-bf2f0ccbfcf8 None None] MFA Rules not processed for user `f538ac5520f04f7aac59aac405a3fea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:46.953267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-dc726270-9d4b-4ea6-9b5f-bf2f0ccbfcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:46.972117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:46.972117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:47.195384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5779786-0a27-434c-8f58-8b2152bc27d0 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:47.217666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77de6-6619-4a47-8e37-a6d73101c3b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:47.224406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77de6-6619-4a47-8e37-a6d73101c3b2 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:47.224406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77de6-6619-4a47-8e37-a6d73101c3b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:47.224406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77de6-6619-4a47-8e37-a6d73101c3b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:47.254600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 866/1733] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:47.262004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc726270-9d4b-4ea6-9b5f-bf2f0ccbfcf8 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:47.303190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:47.438713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77de6-6619-4a47-8e37-a6d73101c3b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:47.441535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77de6-6619-4a47-8e37-a6d73101c3b2 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:47.467123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 868/1734] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:24:47.579594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc726270-9d4b-4ea6-9b5f-bf2f0ccbfcf8 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:47.601236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff7573-4cf6-4990-9f2b-278deedff95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:47.605662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff7573-4cf6-4990-9f2b-278deedff95d admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:47.606725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff7573-4cf6-4990-9f2b-278deedff95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:47.607205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff7573-4cf6-4990-9f2b-278deedff95d admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:47.608394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff7573-4cf6-4990-9f2b-278deedff95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:47.616072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff7573-4cf6-4990-9f2b-278deedff95d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:47.749766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77de6-6619-4a47-8e37-a6d73101c3b2 service swift] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:47.759703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 867/1735] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:24:47 2022] POST /identity/v3/projects => generated 369 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:24:47.768231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77de6-6619-4a47-8e37-a6d73101c3b2 service swift] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:47.836693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:47.994898 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4650a-76dc-4c85-8ad4-9bede14d6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:47.996370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4650a-76dc-4c85-8ad4-9bede14d6086 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:47.996844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4650a-76dc-4c85-8ad4-9bede14d6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:47.997974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4650a-76dc-4c85-8ad4-9bede14d6086 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:47.998922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4650a-76dc-4c85-8ad4-9bede14d6086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:48.001197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4650a-76dc-4c85-8ad4-9bede14d6086 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:48.150302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff7573-4cf6-4990-9f2b-278deedff95d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:48.151274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 869/1736] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:24:47 2022] POST /identity/v3/users => generated 291 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:24:48.175444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff7573-4cf6-4990-9f2b-278deedff95d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:48.191863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15a98-cbab-4ab8-b0c6-3b0991240558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:48.192771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15a98-cbab-4ab8-b0c6-3b0991240558 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:48.193228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15a98-cbab-4ab8-b0c6-3b0991240558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:48.193892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15a98-cbab-4ab8-b0c6-3b0991240558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:48.194801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d15a98-cbab-4ab8-b0c6-3b0991240558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:48.196646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d15a98-cbab-4ab8-b0c6-3b0991240558 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:48.220966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 868/1737] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:48.225251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4650a-76dc-4c85-8ad4-9bede14d6086 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:48.250323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4650a-76dc-4c85-8ad4-9bede14d6086 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:48.267705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171a43-b293-4690-89c8-320dd60de163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:48.275562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171a43-b293-4690-89c8-320dd60de163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:48.275846 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171a43-b293-4690-89c8-320dd60de163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:48.278547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171a43-b293-4690-89c8-320dd60de163 admin admin] PATH_INFO: `/v3/projects/8db9b77c709f430f8799fc73b6903299/users/e01750bca3ab4798a68f6b57eae7ac54/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:48.362680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9171a43-b293-4690-89c8-320dd60de163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db9b77c709f430f8799fc73b6903299, user_id=e01750bca3ab4798a68f6b57eae7ac54, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:48.365553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9171a43-b293-4690-89c8-320dd60de163 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:48.575269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 870/1738] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:48 2022] PUT /identity/v3/projects/8db9b77c709f430f8799fc73b6903299/users/e01750bca3ab4798a68f6b57eae7ac54/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:48.579430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15a98-cbab-4ab8-b0c6-3b0991240558 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:48.595703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15a98-cbab-4ab8-b0c6-3b0991240558 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:48.845247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1f4d8-9b40-428d-b39c-ca7bfe429bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:48.845893 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1f4d8-9b40-428d-b39c-ca7bfe429bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:48.846176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1f4d8-9b40-428d-b39c-ca7bfe429bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:48.846453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1f4d8-9b40-428d-b39c-ca7bfe429bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:48.847168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1f4d8-9b40-428d-b39c-ca7bfe429bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:48.860929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1f4d8-9b40-428d-b39c-ca7bfe429bbd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:48.870514 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171a43-b293-4690-89c8-320dd60de163 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:48.905928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 869/1739] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:24:48.909874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1f4d8-9b40-428d-b39c-ca7bfe429bbd admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:48.946635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1f4d8-9b40-428d-b39c-ca7bfe429bbd admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:48.975129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cf26d-07f0-49a7-8296-2abb379c9477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:48.976827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf26d-07f0-49a7-8296-2abb379c9477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:48.976827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf26d-07f0-49a7-8296-2abb379c9477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:48.976827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf26d-07f0-49a7-8296-2abb379c9477 admin admin] PATH_INFO: `/v3/projects/8db9b77c709f430f8799fc73b6903299/users/e01750bca3ab4798a68f6b57eae7ac54/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:48.983356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cf26d-07f0-49a7-8296-2abb379c9477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db9b77c709f430f8799fc73b6903299, user_id=e01750bca3ab4798a68f6b57eae7ac54, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:48.986238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cf26d-07f0-49a7-8296-2abb379c9477 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:48.987035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9171a43-b293-4690-89c8-320dd60de163 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:48.991831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:48.993484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:48.993973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:48.994419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:48.998095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:49.027768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 870/1740] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:24:48 2022] PUT /identity/v3/projects/8db9b77c709f430f8799fc73b6903299/users/e01750bca3ab4798a68f6b57eae7ac54/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:49.039277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144cfb5-6241-4a6c-ba70-1d61b53c9c54 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:49.039277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144cfb5-6241-4a6c-ba70-1d61b53c9c54 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:49.040378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144cfb5-6241-4a6c-ba70-1d61b53c9c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:49.096549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:49.104706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:49.153024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b144cfb5-6241-4a6c-ba70-1d61b53c9c54 None None] MFA Rules not processed for user `e01750bca3ab4798a68f6b57eae7ac54`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:49.159291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 871/1741] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:49.160675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b144cfb5-6241-4a6c-ba70-1d61b53c9c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:49.194587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:49.414555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 871/1742] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:24:49.572524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:49.579822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:49.595082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e01e7-4392-413a-a7a5-ebd59ffdb0a2 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:49.808652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5f995-3db7-493c-b3b4-12d9e232ed27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:49.814550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f995-3db7-493c-b3b4-12d9e232ed27 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:49.814841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f995-3db7-493c-b3b4-12d9e232ed27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:49.815118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f995-3db7-493c-b3b4-12d9e232ed27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:49.851071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5f995-3db7-493c-b3b4-12d9e232ed27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:49.853464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5f995-3db7-493c-b3b4-12d9e232ed27 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:49.898047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 872/1743] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:49.949407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:51.326864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb8318-bc75-4e8c-adb2-02e4f8d03b78 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:51.328126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb8318-bc75-4e8c-adb2-02e4f8d03b78 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:51.328597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb8318-bc75-4e8c-adb2-02e4f8d03b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:51.406224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c5bb8318-bc75-4e8c-adb2-02e4f8d03b78 None None] MFA Rules not processed for user `a67b35a2567941f59dd746a3813b9d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:51.406224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c5bb8318-bc75-4e8c-adb2-02e4f8d03b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:51.574045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 872/1744] 10.222.0.78 () {58 vars in 1015 bytes} [Thu Aug 4 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:51.587052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432db7-7ec1-4442-ab71-579b94a12849 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:51.587544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432db7-7ec1-4442-ab71-579b94a12849 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:51.587731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432db7-7ec1-4442-ab71-579b94a12849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:51.602957 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb8318-bc75-4e8c-adb2-02e4f8d03b78 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:51.604720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c5bb8318-bc75-4e8c-adb2-02e4f8d03b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:51.631872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb8318-bc75-4e8c-adb2-02e4f8d03b78 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:51.636330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:51.637332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:51.638356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-19432db7-7ec1-4442-ab71-579b94a12849 None None] MFA Rules not processed for user `793d3d46e32b4550b711841f2447461a`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:51.638862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:51.639239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:51.640771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-19432db7-7ec1-4442-ab71-579b94a12849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:51.657700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:51.664123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:51.743084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 873/1745] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:51.755255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 873/1746] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:51.949549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:51.952100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:52.284718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215d41-d076-4d11-9f04-8b0a45267e10 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:52.313740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:52.314681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:52.315820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:52.317877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] PATH_INFO: `/v3/users/011d7103c694467289bd58f0cf780e9f` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:52.320824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011d7103c694467289bd58f0cf780e9f)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:52.330303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:52.676419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011d7103c694467289bd58f0cf780e9f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:52.685315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011d7103c694467289bd58f0cf780e9f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:52.819937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011d7103c694467289bd58f0cf780e9f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:52.855619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011d7103c694467289bd58f0cf780e9f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:52.857147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011d7103c694467289bd58f0cf780e9f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:52.954985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 874/1747] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:24:51 2022] DELETE /identity/v3/users/011d7103c694467289bd58f0cf780e9f => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:52.959617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a201-b448-48c2-bc95-b6c0a988e9cf None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:52.960217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a201-b448-48c2-bc95-b6c0a988e9cf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:52.960217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a201-b448-48c2-bc95-b6c0a988e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:53.041074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7c21a201-b448-48c2-bc95-b6c0a988e9cf None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:53.042458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7c21a201-b448-48c2-bc95-b6c0a988e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:53.151348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:53.274313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 874/1748] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:53.301913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:53.303785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:53.562082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3fa09-2e66-4c8e-ae96-5474c662b1c9 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:53.572114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:53.579465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002174-a2d8-43a1-80d4-2ace4ce4f52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:53.579465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002174-a2d8-43a1-80d4-2ace4ce4f52a service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:53.579465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002174-a2d8-43a1-80d4-2ace4ce4f52a service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:53.579465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002174-a2d8-43a1-80d4-2ace4ce4f52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:53.615047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002174-a2d8-43a1-80d4-2ace4ce4f52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:53.620693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002174-a2d8-43a1-80d4-2ace4ce4f52a service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:53.664867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 875/1749] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:55.470268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:56.021833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc66ea-5fbd-40e1-81b7-df6f56619740 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:56.022786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc66ea-5fbd-40e1-81b7-df6f56619740 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:56.023280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc66ea-5fbd-40e1-81b7-df6f56619740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:56.042516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:56.086452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6bcc66ea-5fbd-40e1-81b7-df6f56619740 None None] MFA Rules not processed for user `e6e5d240443d4a148346bf9f1270b1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:56.086452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6bcc66ea-5fbd-40e1-81b7-df6f56619740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:56.207860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 875/1750] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:56.641689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0e4b-1ddd-450d-a016-06ff4b2e095b None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:56.642151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0e4b-1ddd-450d-a016-06ff4b2e095b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:56.642968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0e4b-1ddd-450d-a016-06ff4b2e095b None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:56.645164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 876/1751] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:24:56.856626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc66ea-5fbd-40e1-81b7-df6f56619740 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:56.860541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6bcc66ea-5fbd-40e1-81b7-df6f56619740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:56.913528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14baa6-dfbf-4f40-b388-c9623e24c36d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:56.913953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14baa6-dfbf-4f40-b388-c9623e24c36d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:56.914575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14baa6-dfbf-4f40-b388-c9623e24c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:56.927371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc66ea-5fbd-40e1-81b7-df6f56619740 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:56.953771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:56.953771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:56.954076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:56.954333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] PATH_INFO: `/v3/users/f538ac5520f04f7aac59aac405a3fea9` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:56.960579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-8f14baa6-dfbf-4f40-b388-c9623e24c36d None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:56.962331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8f14baa6-dfbf-4f40-b388-c9623e24c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:56.962569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f538ac5520f04f7aac59aac405a3fea9)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:56.971668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:57.095691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:57.209644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 877/1752] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:57.346145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14baa6-dfbf-4f40-b388-c9623e24c36d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:57.348856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8f14baa6-dfbf-4f40-b388-c9623e24c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:57.459460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f538ac5520f04f7aac59aac405a3fea9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:57.470054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f538ac5520f04f7aac59aac405a3fea9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:57.473124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f538ac5520f04f7aac59aac405a3fea9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:57.518448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14baa6-dfbf-4f40-b388-c9623e24c36d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:57.524522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e836d9b-a350-4f88-9a9a-e30741cb893b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:57.526064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836d9b-a350-4f88-9a9a-e30741cb893b service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:57.526800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836d9b-a350-4f88-9a9a-e30741cb893b service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:57.529034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836d9b-a350-4f88-9a9a-e30741cb893b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:57.531637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3e836d9b-a350-4f88-9a9a-e30741cb893b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:57.556027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:57.572107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f538ac5520f04f7aac59aac405a3fea9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:57.631456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e836d9b-a350-4f88-9a9a-e30741cb893b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:57.633499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e836d9b-a350-4f88-9a9a-e30741cb893b service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:57.652202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 878/1753] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:24:57.703741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f538ac5520f04f7aac59aac405a3fea9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:57.729646 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 876/1754] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:24:56 2022] DELETE /identity/v3/users/f538ac5520f04f7aac59aac405a3fea9 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:57.735460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209126-affa-49dc-b3a3-f30a1ad3eda7 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:57.737014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209126-affa-49dc-b3a3-f30a1ad3eda7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:57.737014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209126-affa-49dc-b3a3-f30a1ad3eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:57.785115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-46209126-affa-49dc-b3a3-f30a1ad3eda7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:24:57.790600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-46209126-affa-49dc-b3a3-f30a1ad3eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:57.816775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:57.818920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:58.061229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 879/1755] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:24:58.076862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fcdd0-f060-4e4f-9ec3-352a9cc85d61 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:58.094310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:58.094926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:58.095210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:58.095489 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] PATH_INFO: `/v3/projects/b0827f981a374698bb0846537495deaf` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:58.096980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0827f981a374698bb0846537495deaf)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:58.099217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:58.143261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209126-affa-49dc-b3a3-f30a1ad3eda7 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:58.151295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-46209126-affa-49dc-b3a3-f30a1ad3eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:58.306219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209126-affa-49dc-b3a3-f30a1ad3eda7 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:58.306219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:58.306219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:58.306219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:58.306654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:58.327862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:58.329865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:58.371491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 880/1756] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:24:58.373440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:58.376217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:58.418036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0827f981a374698bb0846537495deaf', 'request_id': 'req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:58.444696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0827f981a374698bb0846537495deaf', 'request_id': 'req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:58.574011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4a375-6de0-4c5f-81f1-d5a21fbfd244 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:58.587662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0827f981a374698bb0846537495deaf', 'request_id': 'req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:58.611521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] The token cache is being invalidate because project b0827f981a374698bb0846537495deaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:24:58.613903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:58.615425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:58.646538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 877/1757] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:24:57 2022] DELETE /identity/v3/projects/b0827f981a374698bb0846537495deaf => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:58.653793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:24:58.658142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:58.755504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d8a0-1e0b-45e1-be40-e840ecafe8d5 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:24:58.764124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:58.765378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:58.765901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:58.766408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] PATH_INFO: `/v3/users/92aea733a6bb43c68fe453ccd0405f44` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:58.768181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] RBAC: Authorizing `identity:delete_user(user_id=92aea733a6bb43c68fe453ccd0405f44)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:58.770770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:58.828102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfbad6-0d29-484d-a5a1-b744250a35e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:24:58.829154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfbad6-0d29-484d-a5a1-b744250a35e2 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:24:58.829610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfbad6-0d29-484d-a5a1-b744250a35e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:24:58.830473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfbad6-0d29-484d-a5a1-b744250a35e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:24:58.832662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f0bfbad6-0d29-484d-a5a1-b744250a35e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:24:58.860022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfbad6-0d29-484d-a5a1-b744250a35e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:24:58.863669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfbad6-0d29-484d-a5a1-b744250a35e2 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:24:58.904255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 881/1758] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:24:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:24:59.108115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92aea733a6bb43c68fe453ccd0405f44'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:59.119143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92aea733a6bb43c68fe453ccd0405f44'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:59.122325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92aea733a6bb43c68fe453ccd0405f44'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:59.174969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92aea733a6bb43c68fe453ccd0405f44'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:59.329151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-16578752-afcb-4bbe-89dc-180279a9175f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92aea733a6bb43c68fe453ccd0405f44'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:24:59.360745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 878/1759] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:24:58 2022] DELETE /identity/v3/users/92aea733a6bb43c68fe453ccd0405f44 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:24:59.554343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:24:59.883117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:00.173299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c9e2-2672-49a6-bbce-9774473c8a51 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:00.173616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c9e2-2672-49a6-bbce-9774473c8a51 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:00.173898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325c9e2-2672-49a6-bbce-9774473c8a51 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:00.177220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 882/1760] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:25:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:25:00.318429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912538c-4c48-497a-8b9e-dedaaa5058bd None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:00.318926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912538c-4c48-497a-8b9e-dedaaa5058bd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:00.318998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912538c-4c48-497a-8b9e-dedaaa5058bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:00.375651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b912538c-4c48-497a-8b9e-dedaaa5058bd None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:00.377970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b912538c-4c48-497a-8b9e-dedaaa5058bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:00.517550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325c9e2-2672-49a6-bbce-9774473c8a51 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:00.519416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-2325c9e2-2672-49a6-bbce-9774473c8a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:00.626503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 879/1761] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:00.742756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325c9e2-2672-49a6-bbce-9774473c8a51 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:00.756372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:00.757068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:00.757346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:00.757620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] PATH_INFO: `/v3/projects/a0ed5d24e7f14b0885db84cd6a889cdb` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:00.760009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ed5d24e7f14b0885db84cd6a889cdb)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:00.762270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:00.956441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ed5d24e7f14b0885db84cd6a889cdb', 'request_id': 'req-ca5dca4a-312a-4410-90f3-1e6c886a745c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:00.967898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ed5d24e7f14b0885db84cd6a889cdb', 'request_id': 'req-ca5dca4a-312a-4410-90f3-1e6c886a745c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:01.075532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ed5d24e7f14b0885db84cd6a889cdb', 'request_id': 'req-ca5dca4a-312a-4410-90f3-1e6c886a745c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:01.098225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] The token cache is being invalidate because project a0ed5d24e7f14b0885db84cd6a889cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:01.098498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:01.102869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:01.112529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 883/1762] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:00 2022] DELETE /identity/v3/projects/a0ed5d24e7f14b0885db84cd6a889cdb => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:01.114076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912538c-4c48-497a-8b9e-dedaaa5058bd None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:01.142198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912538c-4c48-497a-8b9e-dedaaa5058bd None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:01.371370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:01.372736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:01.373045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:01.373382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] PATH_INFO: `/v3/users/e01750bca3ab4798a68f6b57eae7ac54` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:01.375819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01750bca3ab4798a68f6b57eae7ac54)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:01.378779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:01.607496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:01.609100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:01.737108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01750bca3ab4798a68f6b57eae7ac54'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:01.738981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01750bca3ab4798a68f6b57eae7ac54'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:01.740178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01750bca3ab4798a68f6b57eae7ac54'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:01.754343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dca4a-312a-4410-90f3-1e6c886a745c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:01.770645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:01.777709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:01.783008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:01.783183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01750bca3ab4798a68f6b57eae7ac54'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:01.783277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:01.787723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:01.820193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:01.829008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:01.837328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 884/1763] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:01.977378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01750bca3ab4798a68f6b57eae7ac54'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:02.016299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 880/1764] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:01 2022] DELETE /identity/v3/users/e01750bca3ab4798a68f6b57eae7ac54 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:02.224367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:02.646074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:03.154983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:03.232620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:03.235488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:03.268256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192d65f-7672-4d61-8de0-2bd627b5b80f service nova] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:03.463918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:03.467128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:03.467428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:03.467815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] PATH_INFO: `/v3/projects/6e3353520dcf48feb617fb048bed4f80` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:03.473129 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3353520dcf48feb617fb048bed4f80)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:03.484294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:03.736722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:03.738268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:03.757703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3353520dcf48feb617fb048bed4f80', 'request_id': 'req-b01cc486-051d-47dd-88fc-c5d1fe60c97b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:03.761062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde1fd-af2a-4cab-9e60-2bf7c9026ba6 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:03.765108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3353520dcf48feb617fb048bed4f80', 'request_id': 'req-b01cc486-051d-47dd-88fc-c5d1fe60c97b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:03.843522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:03.844168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:03.844442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:03.844710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] PATH_INFO: `/v3/projects/8db9b77c709f430f8799fc73b6903299` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:03.845977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db9b77c709f430f8799fc73b6903299)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:03.847882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:03.876037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3353520dcf48feb617fb048bed4f80', 'request_id': 'req-b01cc486-051d-47dd-88fc-c5d1fe60c97b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:03.889510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] The token cache is being invalidate because project 6e3353520dcf48feb617fb048bed4f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:03.889825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:03.890500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b01cc486-051d-47dd-88fc-c5d1fe60c97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:03.892066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 885/1765] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:03 2022] DELETE /identity/v3/projects/6e3353520dcf48feb617fb048bed4f80 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:03.898248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f193f-51f6-41a4-9973-59929d199628 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:03.898539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f193f-51f6-41a4-9973-59929d199628 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:03.898811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f193f-51f6-41a4-9973-59929d199628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:03.923235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3b2f193f-51f6-41a4-9973-59929d199628 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:03.926760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3b2f193f-51f6-41a4-9973-59929d199628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:03.947836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 886/1766] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:03.950932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37051aa-d649-40d6-bbf8-8a694b555ef8 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:03.951478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37051aa-d649-40d6-bbf8-8a694b555ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:03.951726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37051aa-d649-40d6-bbf8-8a694b555ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:03.975942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f37051aa-d649-40d6-bbf8-8a694b555ef8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:03.989580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f37051aa-d649-40d6-bbf8-8a694b555ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:04.009150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db9b77c709f430f8799fc73b6903299', 'request_id': 'req-625be0ac-97cb-4966-bf36-19271c16bd68'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:04.022472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db9b77c709f430f8799fc73b6903299', 'request_id': 'req-625be0ac-97cb-4966-bf36-19271c16bd68'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:04.097677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 887/1767] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:04.101973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37051aa-d649-40d6-bbf8-8a694b555ef8 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.104770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db9b77c709f430f8799fc73b6903299', 'request_id': 'req-625be0ac-97cb-4966-bf36-19271c16bd68'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:04.118333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37051aa-d649-40d6-bbf8-8a694b555ef8 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.125218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] The token cache is being invalidate because project 8db9b77c709f430f8799fc73b6903299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:04.125701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:04.127314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-625be0ac-97cb-4966-bf36-19271c16bd68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:04.133493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 881/1768] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:03 2022] DELETE /identity/v3/projects/8db9b77c709f430f8799fc73b6903299 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:04.139482 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.139774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41f4d-3794-4fcc-a97f-38a9fb450606 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.140219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41f4d-3794-4fcc-a97f-38a9fb450606 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.141119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41f4d-3794-4fcc-a97f-38a9fb450606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.141237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.142601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.143012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.149266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:04.149266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.150551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.191251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 888/1769] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:25:04.191835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-fad41f4d-3794-4fcc-a97f-38a9fb450606 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:04.192701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.192942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fad41f4d-3794-4fcc-a97f-38a9fb450606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:04.207553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:04.209936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:04.222484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 882/1770] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:04.230245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde97b34-81e4-486e-8289-8bca36e2e927 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.230864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde97b34-81e4-486e-8289-8bca36e2e927 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.232202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde97b34-81e4-486e-8289-8bca36e2e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.239175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906e7c8-516b-4380-99da-116c91bb1c1a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.244741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d730751-1dd0-440a-98b9-56e0a7dc08d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.247397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d730751-1dd0-440a-98b9-56e0a7dc08d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.249740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d730751-1dd0-440a-98b9-56e0a7dc08d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.249740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d730751-1dd0-440a-98b9-56e0a7dc08d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.249740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d730751-1dd0-440a-98b9-56e0a7dc08d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.256197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d730751-1dd0-440a-98b9-56e0a7dc08d2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.258319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-bde97b34-81e4-486e-8289-8bca36e2e927 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:04.260289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bde97b34-81e4-486e-8289-8bca36e2e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:04.272975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 883/1771] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:04.277061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde97b34-81e4-486e-8289-8bca36e2e927 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.290540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde97b34-81e4-486e-8289-8bca36e2e927 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.297006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.297851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.298130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.298389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.299078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:04.299374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.301000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.315901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 884/1772] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:25:04.320152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.330913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5a2f-636c-47b5-b745-0d8c49fd6c66 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.337335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88797d1a-7d84-4b1f-b3c1-a5a9d8f54550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.337335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797d1a-7d84-4b1f-b3c1-a5a9d8f54550 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.337335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797d1a-7d84-4b1f-b3c1-a5a9d8f54550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.337335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797d1a-7d84-4b1f-b3c1-a5a9d8f54550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.337944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88797d1a-7d84-4b1f-b3c1-a5a9d8f54550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.339837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88797d1a-7d84-4b1f-b3c1-a5a9d8f54550 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.405355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 889/1773] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:04 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:04.410971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d730751-1dd0-440a-98b9-56e0a7dc08d2 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.461260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 885/1774] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:04 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:04.466612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88797d1a-7d84-4b1f-b3c1-a5a9d8f54550 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.502500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d730751-1dd0-440a-98b9-56e0a7dc08d2 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.601543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88797d1a-7d84-4b1f-b3c1-a5a9d8f54550 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.614268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.616413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.616645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.616945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.617657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.622969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.635422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece184ab-b149-4584-9d07-a25b52c85f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.638032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece184ab-b149-4584-9d07-a25b52c85f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.638399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece184ab-b149-4584-9d07-a25b52c85f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.638683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece184ab-b149-4584-9d07-a25b52c85f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.639524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece184ab-b149-4584-9d07-a25b52c85f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.642310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece184ab-b149-4584-9d07-a25b52c85f95 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.739803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 886/1775] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:04 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:04.741257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.743073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:04.761114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc9a82-66e5-4fe2-8621-35d5304dc34c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.770464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.771361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.771868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.772624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] PATH_INFO: `/v3/users/e264d06c1a8f45f4b94ebba1867233e7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.774183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e264d06c1a8f45f4b94ebba1867233e7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.783154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.783238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 890/1776] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:04 2022] POST /identity/v3/users => generated 292 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:04.783238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece184ab-b149-4584-9d07-a25b52c85f95 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.814422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece184ab-b149-4584-9d07-a25b52c85f95 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.819108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1b9c-d230-4fc4-9a77-3817d44c1cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.819724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1b9c-d230-4fc4-9a77-3817d44c1cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.819998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1b9c-d230-4fc4-9a77-3817d44c1cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.820264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1b9c-d230-4fc4-9a77-3817d44c1cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.820979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a1b9c-d230-4fc4-9a77-3817d44c1cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.822735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a1b9c-d230-4fc4-9a77-3817d44c1cc0 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.834431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 891/1777] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:04.835314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1b9c-d230-4fc4-9a77-3817d44c1cc0 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.845446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1b9c-d230-4fc4-9a77-3817d44c1cc0 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.852304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c599776-c98e-4100-95ca-6e66596482e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.852956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599776-c98e-4100-95ca-6e66596482e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.853237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599776-c98e-4100-95ca-6e66596482e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.853511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599776-c98e-4100-95ca-6e66596482e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.854199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c599776-c98e-4100-95ca-6e66596482e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.855820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c599776-c98e-4100-95ca-6e66596482e1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.868088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 892/1778] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:04.869202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c599776-c98e-4100-95ca-6e66596482e1 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.881673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c599776-c98e-4100-95ca-6e66596482e1 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.886364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af735573-c728-47b4-8d37-12fc347addd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.886979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735573-c728-47b4-8d37-12fc347addd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.887287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735573-c728-47b4-8d37-12fc347addd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.887565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735573-c728-47b4-8d37-12fc347addd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.888724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af735573-c728-47b4-8d37-12fc347addd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.890390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af735573-c728-47b4-8d37-12fc347addd4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.900782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 893/1779] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:04.901630 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af735573-c728-47b4-8d37-12fc347addd4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.912297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af735573-c728-47b4-8d37-12fc347addd4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.916910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2de06-e570-4572-944a-9bd31f1abcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.917525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2de06-e570-4572-944a-9bd31f1abcad admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.917799 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2de06-e570-4572-944a-9bd31f1abcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.918069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2de06-e570-4572-944a-9bd31f1abcad admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.919323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2de06-e570-4572-944a-9bd31f1abcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.921414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2de06-e570-4572-944a-9bd31f1abcad admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:04.931926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 894/1780] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:04.932692 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2de06-e570-4572-944a-9bd31f1abcad admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:04.944074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2de06-e570-4572-944a-9bd31f1abcad admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:04.949444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:04.950289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:04.950795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:04.951082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] PATH_INFO: `/v3/projects/cc65f5d8dfc84fec8b96921508471685/users/1111e490d47b471eb017342eb95c9bbb/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:04.967824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc65f5d8dfc84fec8b96921508471685, user_id=1111e490d47b471eb017342eb95c9bbb, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:04.970548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:05.063328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e264d06c1a8f45f4b94ebba1867233e7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:05.064042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e264d06c1a8f45f4b94ebba1867233e7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:05.064644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e264d06c1a8f45f4b94ebba1867233e7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:05.082596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e264d06c1a8f45f4b94ebba1867233e7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:05.092921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 895/1781] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:04 2022] PUT /identity/v3/projects/cc65f5d8dfc84fec8b96921508471685/users/1111e490d47b471eb017342eb95c9bbb/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:05.094015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:05.097387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:05.165105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baefed5-f2f2-479f-8ce6-6dee8b5e2fd4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:05.170556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcd73d-b356-4183-a205-304769f98936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:05.171231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcd73d-b356-4183-a205-304769f98936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.172259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcd73d-b356-4183-a205-304769f98936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.172259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcd73d-b356-4183-a205-304769f98936 admin admin] PATH_INFO: `/v3/projects/7a8cc21fbbb64f948ba86e2f1403adcd/users/f9f7e27be1c245068369db9d51e0aef1/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.188378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcd73d-b356-4183-a205-304769f98936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8cc21fbbb64f948ba86e2f1403adcd, user_id=f9f7e27be1c245068369db9d51e0aef1, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:05.191157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcd73d-b356-4183-a205-304769f98936 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:05.195681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c99b4c7f-fc92-4a6d-bf80-6eb03ef6d24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e264d06c1a8f45f4b94ebba1867233e7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:05.222475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:05.235783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 887/1782] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:04 2022] DELETE /identity/v3/users/e264d06c1a8f45f4b94ebba1867233e7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:05.235783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b95f50-46f3-4790-ae71-b3f0c1fcc556 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.235783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b95f50-46f3-4790-ae71-b3f0c1fcc556 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.235783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b95f50-46f3-4790-ae71-b3f0c1fcc556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.280651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-28b95f50-46f3-4790-ae71-b3f0c1fcc556 None None] MFA Rules not processed for user `1111e490d47b471eb017342eb95c9bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:05.282095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-28b95f50-46f3-4790-ae71-b3f0c1fcc556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:05.300061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 896/1783] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:05 2022] PUT /identity/v3/projects/7a8cc21fbbb64f948ba86e2f1403adcd/users/f9f7e27be1c245068369db9d51e0aef1/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:05.301700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55349275-da68-4b0a-b11a-d9e377db2b3d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.302166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55349275-da68-4b0a-b11a-d9e377db2b3d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.302498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55349275-da68-4b0a-b11a-d9e377db2b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.329415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-55349275-da68-4b0a-b11a-d9e377db2b3d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:05.330627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-55349275-da68-4b0a-b11a-d9e377db2b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:05.358346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 888/1784] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:05.360444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604745-25ca-4914-b9b7-995cc3e6c59d None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.360832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604745-25ca-4914-b9b7-995cc3e6c59d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.361233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e604745-25ca-4914-b9b7-995cc3e6c59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.396103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6e604745-25ca-4914-b9b7-995cc3e6c59d None None] MFA Rules not processed for user `f9f7e27be1c245068369db9d51e0aef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:05.397773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6e604745-25ca-4914-b9b7-995cc3e6c59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:05.401412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 897/1785] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:05.402414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55349275-da68-4b0a-b11a-d9e377db2b3d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:05.404051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-55349275-da68-4b0a-b11a-d9e377db2b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:05.417647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55349275-da68-4b0a-b11a-d9e377db2b3d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:05.423796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d5033-72af-469b-ac68-162e04813d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:05.424551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d5033-72af-469b-ac68-162e04813d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.424984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d5033-72af-469b-ac68-162e04813d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.425348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d5033-72af-469b-ac68-162e04813d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.426246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d5033-72af-469b-ac68-162e04813d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:05.428460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d5033-72af-469b-ac68-162e04813d13 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:05.475463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 889/1786] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:05.476391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e604745-25ca-4914-b9b7-995cc3e6c59d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:05.477721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6e604745-25ca-4914-b9b7-995cc3e6c59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:05.532918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 898/1787] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:05 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:05.533440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d5033-72af-469b-ac68-162e04813d13 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:05.539404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e604745-25ca-4914-b9b7-995cc3e6c59d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:05.599021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada642e-bbb7-49da-8029-10618fbc6593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:05.599968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada642e-bbb7-49da-8029-10618fbc6593 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.600322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada642e-bbb7-49da-8029-10618fbc6593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.600680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada642e-bbb7-49da-8029-10618fbc6593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.604694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d5033-72af-469b-ac68-162e04813d13 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:05.610286 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad585-ed78-4cf5-92d1-dab2bcb50f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:05.610908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad585-ed78-4cf5-92d1-dab2bcb50f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.611192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad585-ed78-4cf5-92d1-dab2bcb50f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.614521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad585-ed78-4cf5-92d1-dab2bcb50f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.614521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ad585-ed78-4cf5-92d1-dab2bcb50f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:05.614720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada642e-bbb7-49da-8029-10618fbc6593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:05.614720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada642e-bbb7-49da-8029-10618fbc6593 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:05.615063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ad585-ed78-4cf5-92d1-dab2bcb50f19 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:05.626080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 890/1788] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:05.627055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada642e-bbb7-49da-8029-10618fbc6593 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:05.636690 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada642e-bbb7-49da-8029-10618fbc6593 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:05.643303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd9763-226f-4136-ad1a-d1a84aa4d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:05.643303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9763-226f-4136-ad1a-d1a84aa4d0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.643686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9763-226f-4136-ad1a-d1a84aa4d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.643686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9763-226f-4136-ad1a-d1a84aa4d0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.644289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd9763-226f-4136-ad1a-d1a84aa4d0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:05.646402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd9763-226f-4136-ad1a-d1a84aa4d0c3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:05.763267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 891/1789] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:05 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:05.764001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 899/1790] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:05 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:05.767861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad585-ed78-4cf5-92d1-dab2bcb50f19 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:05.769969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd9763-226f-4136-ad1a-d1a84aa4d0c3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:05.781888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd9763-226f-4136-ad1a-d1a84aa4d0c3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:05.857889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad585-ed78-4cf5-92d1-dab2bcb50f19 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:05.863133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e449ba-71b0-4945-ab94-d8394ff4c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:05.863823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e449ba-71b0-4945-ab94-d8394ff4c394 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.864359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0afd-eb52-4ea4-a41a-be67443de421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:05.864479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e449ba-71b0-4945-ab94-d8394ff4c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.864762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e449ba-71b0-4945-ab94-d8394ff4c394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.865019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0afd-eb52-4ea4-a41a-be67443de421 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.865466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0afd-eb52-4ea4-a41a-be67443de421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.865579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e449ba-71b0-4945-ab94-d8394ff4c394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:05.865971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0afd-eb52-4ea4-a41a-be67443de421 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.866771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad0afd-eb52-4ea4-a41a-be67443de421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:05.867282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e449ba-71b0-4945-ab94-d8394ff4c394 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:05.870243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad0afd-eb52-4ea4-a41a-be67443de421 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:05.881973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 900/1791] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:25:05.888791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e449ba-71b0-4945-ab94-d8394ff4c394 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:05.904806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e449ba-71b0-4945-ab94-d8394ff4c394 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:05.911596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64986526-8c64-41b6-8794-cc1a0c809b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:05.912372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64986526-8c64-41b6-8794-cc1a0c809b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:05.912655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64986526-8c64-41b6-8794-cc1a0c809b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:05.913263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64986526-8c64-41b6-8794-cc1a0c809b08 admin admin] PATH_INFO: `/v3/projects/17be4b249ee7404f854d27861113abb7/users/84f11e555f484d69be7e8cb22816f93c/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:05.934948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64986526-8c64-41b6-8794-cc1a0c809b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17be4b249ee7404f854d27861113abb7, user_id=84f11e555f484d69be7e8cb22816f93c, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:05.952570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64986526-8c64-41b6-8794-cc1a0c809b08 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.049509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 892/1792] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:05 2022] POST /identity/v3/users => generated 297 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:06.053531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0afd-eb52-4ea4-a41a-be67443de421 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.064037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0afd-eb52-4ea4-a41a-be67443de421 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.069494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c524-c8f3-4ce6-8cfe-9d17f83e79af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.072953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c524-c8f3-4ce6-8cfe-9d17f83e79af admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.073707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c524-c8f3-4ce6-8cfe-9d17f83e79af admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.074218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c524-c8f3-4ce6-8cfe-9d17f83e79af admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.090389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00c524-c8f3-4ce6-8cfe-9d17f83e79af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.090389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00c524-c8f3-4ce6-8cfe-9d17f83e79af admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.091207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 901/1793] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:05 2022] PUT /identity/v3/projects/17be4b249ee7404f854d27861113abb7/users/84f11e555f484d69be7e8cb22816f93c/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:06.091301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 893/1794] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:25:06.094163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64986526-8c64-41b6-8794-cc1a0c809b08 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.095827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c524-c8f3-4ce6-8cfe-9d17f83e79af admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.105994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c524-c8f3-4ce6-8cfe-9d17f83e79af admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.167075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9860eee-9e6e-4689-aadd-f10214675e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.167857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860eee-9e6e-4689-aadd-f10214675e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.168142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860eee-9e6e-4689-aadd-f10214675e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.168420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860eee-9e6e-4689-aadd-f10214675e46 admin admin] PATH_INFO: `/v3/projects/64fd085d893549debcea847d9dd8936d/users/945c1ba1e5ba416693bb5c3123c193a5/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.170923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64986526-8c64-41b6-8794-cc1a0c809b08 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.176348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3606486-cd43-4b99-9d46-3e1f8f568fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.177200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3606486-cd43-4b99-9d46-3e1f8f568fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.177662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3606486-cd43-4b99-9d46-3e1f8f568fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.178132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3606486-cd43-4b99-9d46-3e1f8f568fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.179043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3606486-cd43-4b99-9d46-3e1f8f568fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.181358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3606486-cd43-4b99-9d46-3e1f8f568fcc admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.192767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 902/1795] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:25:06.196904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3606486-cd43-4b99-9d46-3e1f8f568fcc admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.213036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3606486-cd43-4b99-9d46-3e1f8f568fcc admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.213832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9860eee-9e6e-4689-aadd-f10214675e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fd085d893549debcea847d9dd8936d, user_id=945c1ba1e5ba416693bb5c3123c193a5, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.218175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9860eee-9e6e-4689-aadd-f10214675e46 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.220559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.221313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.222071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.222071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] PATH_INFO: `/v3/projects/17be4b249ee7404f854d27861113abb7/users/84f11e555f484d69be7e8cb22816f93c/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.228754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17be4b249ee7404f854d27861113abb7, user_id=84f11e555f484d69be7e8cb22816f93c, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.233341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.244851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 903/1796] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:06 2022] PUT /identity/v3/projects/17be4b249ee7404f854d27861113abb7/users/84f11e555f484d69be7e8cb22816f93c/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:06.245774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.247535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:06.299020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 894/1797] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:06 2022] PUT /identity/v3/projects/64fd085d893549debcea847d9dd8936d/users/945c1ba1e5ba416693bb5c3123c193a5/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:06.305651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7c71-3ef8-44a8-bf35-e56304352e7c None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.305651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7c71-3ef8-44a8-bf35-e56304352e7c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.305651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7c71-3ef8-44a8-bf35-e56304352e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.335202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e8bc7c71-3ef8-44a8-bf35-e56304352e7c None None] MFA Rules not processed for user `84f11e555f484d69be7e8cb22816f93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:06.335864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829d8a-0878-4a6c-b6b6-cabd019b481f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.336783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e8bc7c71-3ef8-44a8-bf35-e56304352e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:06.402295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.403704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.404781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.405316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] PATH_INFO: `/v3/projects/5801e3aab4f448b38672c87cceb991dd` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.406911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5801e3aab4f448b38672c87cceb991dd)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.408856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.455511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 895/1798] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:06.455511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7c71-3ef8-44a8-bf35-e56304352e7c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.455511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7c71-3ef8-44a8-bf35-e56304352e7c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.455511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.455868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.455868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.455868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.455868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.455868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.470963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 896/1799] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:06.471697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.473413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:06.535827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a47c5-27d4-486f-8f6b-e247497a523c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.539638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d209f-2526-472d-be9f-4841ba126659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.540363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d209f-2526-472d-be9f-4841ba126659 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.540713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d209f-2526-472d-be9f-4841ba126659 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.541093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d209f-2526-472d-be9f-4841ba126659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.555381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d209f-2526-472d-be9f-4841ba126659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.557086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d209f-2526-472d-be9f-4841ba126659 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.559006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5801e3aab4f448b38672c87cceb991dd', 'request_id': 'req-34efc8e1-0747-4ff1-87ae-d81d1c321e24'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.565815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5801e3aab4f448b38672c87cceb991dd', 'request_id': 'req-34efc8e1-0747-4ff1-87ae-d81d1c321e24'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.568205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 897/1800] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:06.569792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d209f-2526-472d-be9f-4841ba126659 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.581318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d209f-2526-472d-be9f-4841ba126659 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.641528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5801e3aab4f448b38672c87cceb991dd', 'request_id': 'req-34efc8e1-0747-4ff1-87ae-d81d1c321e24'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.657900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] The token cache is being invalidate because project 5801e3aab4f448b38672c87cceb991dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:06.658187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.658843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.659449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.660182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.660377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 904/1801] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:06 2022] DELETE /identity/v3/projects/5801e3aab4f448b38672c87cceb991dd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:06.660461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.661169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.662616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:06.663704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] PATH_INFO: `/v3/projects/64fd085d893549debcea847d9dd8936d/users/945c1ba1e5ba416693bb5c3123c193a5/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.665809 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fd085d893549debcea847d9dd8936d, user_id=945c1ba1e5ba416693bb5c3123c193a5, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.669378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.677378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc8e1-0747-4ff1-87ae-d81d1c321e24 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.680804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 898/1802] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:06 2022] PUT /identity/v3/projects/64fd085d893549debcea847d9dd8936d/users/945c1ba1e5ba416693bb5c3123c193a5/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:06.681734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:06.685179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:06.706480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:06.739777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.740345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.740622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.740910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] PATH_INFO: `/v3/users/1111e490d47b471eb017342eb95c9bbb` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.742109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1111e490d47b471eb017342eb95c9bbb)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.744038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.760211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c5c45-1c75-4a6e-bf9b-af788f46578f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:06.765367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:06.766147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:06.766511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:06.766866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] PATH_INFO: `/v3/users/aea766a21ac0488d806f8facb2d58a62` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:06.768139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea766a21ac0488d806f8facb2d58a62)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:06.770090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:06.923804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1111e490d47b471eb017342eb95c9bbb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.930832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1111e490d47b471eb017342eb95c9bbb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.985094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea766a21ac0488d806f8facb2d58a62'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.985961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea766a21ac0488d806f8facb2d58a62'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:06.986677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea766a21ac0488d806f8facb2d58a62'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:07.000592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1111e490d47b471eb017342eb95c9bbb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:07.001664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea766a21ac0488d806f8facb2d58a62'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:07.026828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1111e490d47b471eb017342eb95c9bbb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:07.028045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-adb1e458-77e5-4b31-8756-59ada2089f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1111e490d47b471eb017342eb95c9bbb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:07.035420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 905/1803] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:06 2022] DELETE /identity/v3/users/1111e490d47b471eb017342eb95c9bbb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:07.036683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c70f-d8bb-437a-ba6b-a6f10c84a0de None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:07.036997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c70f-d8bb-437a-ba6b-a6f10c84a0de None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:07.037271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c70f-d8bb-437a-ba6b-a6f10c84a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:07.070822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1e43c70f-d8bb-437a-ba6b-a6f10c84a0de None None] MFA Rules not processed for user `945c1ba1e5ba416693bb5c3123c193a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:07.072046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1e43c70f-d8bb-437a-ba6b-a6f10c84a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:07.076830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9127b3a1-244d-4f60-ac0c-c1d59debbb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea766a21ac0488d806f8facb2d58a62'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:07.099473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 899/1804] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:06 2022] DELETE /identity/v3/users/aea766a21ac0488d806f8facb2d58a62 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:07.101427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5beee-a876-4dd5-b260-6286810b632f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:07.102007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5beee-a876-4dd5-b260-6286810b632f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:07.102486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5beee-a876-4dd5-b260-6286810b632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:07.139071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cba5beee-a876-4dd5-b260-6286810b632f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:07.141097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cba5beee-a876-4dd5-b260-6286810b632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:07.163524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 906/1805] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:07.171607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c70f-d8bb-437a-ba6b-a6f10c84a0de None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:07.173457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1e43c70f-d8bb-437a-ba6b-a6f10c84a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:07.253359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 900/1806] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:07.268808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5beee-a876-4dd5-b260-6286810b632f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:07.271286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cba5beee-a876-4dd5-b260-6286810b632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:07.281924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c70f-d8bb-437a-ba6b-a6f10c84a0de None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:07.347297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:07.347992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:07.347992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:07.347992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:07.369317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5beee-a876-4dd5-b260-6286810b632f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:07.374254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeb1d8-ea2e-40db-9173-70e1e7d73757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:07.374891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb1d8-ea2e-40db-9173-70e1e7d73757 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:07.375170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb1d8-ea2e-40db-9173-70e1e7d73757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:07.378574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb1d8-ea2e-40db-9173-70e1e7d73757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:07.386122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeb1d8-ea2e-40db-9173-70e1e7d73757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:07.389432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeb1d8-ea2e-40db-9173-70e1e7d73757 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:07.401118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 901/1807] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:07.444649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:07.446963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:07.494504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 907/1808] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:07.548569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:07.726565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeb1d8-ea2e-40db-9173-70e1e7d73757 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:07.739227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeb1d8-ea2e-40db-9173-70e1e7d73757 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:07.744313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:07.745126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:07.745500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:07.746211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:07.748917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:07.844822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:07.846362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:07.861319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 902/1809] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:07.983202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:07.985073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:08.007153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26d47-6012-402d-8373-10ab75d7ea69 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:08.014545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:08.015597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:08.016143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:08.016621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] PATH_INFO: `/v3/projects/6dde9d7808964f59bd684347adb9316e` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:08.019790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dde9d7808964f59bd684347adb9316e)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:08.022922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:08.213321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dde9d7808964f59bd684347adb9316e', 'request_id': 'req-a38b4127-6013-4331-9e14-a3ae1bdeca8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.224595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dde9d7808964f59bd684347adb9316e', 'request_id': 'req-a38b4127-6013-4331-9e14-a3ae1bdeca8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.367432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dde9d7808964f59bd684347adb9316e', 'request_id': 'req-a38b4127-6013-4331-9e14-a3ae1bdeca8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.387139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] The token cache is being invalidate because project 6dde9d7808964f59bd684347adb9316e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:08.387708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.389348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.392111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 908/1810] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:07 2022] DELETE /identity/v3/projects/6dde9d7808964f59bd684347adb9316e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:08.396108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:08.414288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84028ccb-5496-4d4c-b96f-63c6ff9e41b6 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:08.491574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:08.492704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:08.493204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:08.493679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] PATH_INFO: `/v3/users/7bb0e627693d455982408a36acfe7a00` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:08.495726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb0e627693d455982408a36acfe7a00)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:08.500355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:08.527060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:08.528805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:08.550354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4127-6013-4331-9e14-a3ae1bdeca8b admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:08.559109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:08.560552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:08.561094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:08.561522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] PATH_INFO: `/v3/users/f9f7e27be1c245068369db9d51e0aef1` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:08.563175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f7e27be1c245068369db9d51e0aef1)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:08.565537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:08.758271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb0e627693d455982408a36acfe7a00'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.759037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb0e627693d455982408a36acfe7a00'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.760444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb0e627693d455982408a36acfe7a00'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.782466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb0e627693d455982408a36acfe7a00'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.798966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f7e27be1c245068369db9d51e0aef1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.806225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f7e27be1c245068369db9d51e0aef1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:08.941756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-15ea2dc9-f789-47dc-8b0e-7c8ffaab7b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb0e627693d455982408a36acfe7a00'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.016141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 903/1811] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:08 2022] DELETE /identity/v3/users/7bb0e627693d455982408a36acfe7a00 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:09.081326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f7e27be1c245068369db9d51e0aef1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.107254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f7e27be1c245068369db9d51e0aef1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.119087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f7e27be1c245068369db9d51e0aef1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.135795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 909/1812] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:08 2022] DELETE /identity/v3/users/f9f7e27be1c245068369db9d51e0aef1 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:09.141420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7b29-8257-4705-b4fa-26fee3886308 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:09.141747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7b29-8257-4705-b4fa-26fee3886308 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:09.141971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7b29-8257-4705-b4fa-26fee3886308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:09.159947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:09.162229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:09.166289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:09.180047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-037d7b29-8257-4705-b4fa-26fee3886308 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:09.182533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-037d7b29-8257-4705-b4fa-26fee3886308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:09.330678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac38397-26c8-45f4-8e0e-576754452ebd admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:09.338141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:09.338952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:09.339234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:09.339504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] PATH_INFO: `/v3/projects/cc65f5d8dfc84fec8b96921508471685` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:09.341404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc65f5d8dfc84fec8b96921508471685)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:09.343342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 904/1813] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:09.344381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:09.393247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d7b29-8257-4705-b4fa-26fee3886308 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:09.394768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-037d7b29-8257-4705-b4fa-26fee3886308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:09.460038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d7b29-8257-4705-b4fa-26fee3886308 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:09.464924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ed8d-346e-465c-b76d-0c62e86e8e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:09.464924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ed8d-346e-465c-b76d-0c62e86e8e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:09.465636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ed8d-346e-465c-b76d-0c62e86e8e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:09.465636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ed8d-346e-465c-b76d-0c62e86e8e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:09.479762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ed8d-346e-465c-b76d-0c62e86e8e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:09.482461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ed8d-346e-465c-b76d-0c62e86e8e9f service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:09.494256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 905/1814] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:09.526095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc65f5d8dfc84fec8b96921508471685', 'request_id': 'req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.535992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc65f5d8dfc84fec8b96921508471685', 'request_id': 'req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.617157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc65f5d8dfc84fec8b96921508471685', 'request_id': 'req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.633775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] The token cache is being invalidate because project cc65f5d8dfc84fec8b96921508471685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:09.634411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.635703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.638686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 910/1815] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:09 2022] DELETE /identity/v3/projects/cc65f5d8dfc84fec8b96921508471685 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:09.642548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ed8d-346e-465c-b76d-0c62e86e8e9f service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:09.659492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ed8d-346e-465c-b76d-0c62e86e8e9f service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:09.704713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:09.755552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:09.756318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:09.756601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:09.757087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] PATH_INFO: `/v3/users/84f11e555f484d69be7e8cb22816f93c` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:09.758470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f11e555f484d69be7e8cb22816f93c)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:09.760992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:09.980150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f11e555f484d69be7e8cb22816f93c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.983223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f11e555f484d69be7e8cb22816f93c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:09.984376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f11e555f484d69be7e8cb22816f93c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.004433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f11e555f484d69be7e8cb22816f93c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.091675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f11e555f484d69be7e8cb22816f93c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.110449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 906/1816] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:09 2022] DELETE /identity/v3/users/84f11e555f484d69be7e8cb22816f93c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:10.327622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:10.363677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:10.365212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:10.378921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b842b2c-f9b5-433b-94bd-2b480cb6dce1 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:10.397968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:10.399610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:10.476624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:10.477469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:10.477937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:10.478435 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] PATH_INFO: `/v3/projects/1e225dd11d874817ad1dd515823e2aa8` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:10.479910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e225dd11d874817ad1dd515823e2aa8)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:10.483002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:10.536659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94dee6-400b-40b3-b497-c3d13c92c2c8 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:10.544544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:10.545341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:10.545563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:10.545839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] PATH_INFO: `/v3/projects/7a8cc21fbbb64f948ba86e2f1403adcd` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:10.547258 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8cc21fbbb64f948ba86e2f1403adcd)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:10.549263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:10.823989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:10.881444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e225dd11d874817ad1dd515823e2aa8', 'request_id': 'req-cfcb8dad-9ad4-467b-af47-a9329e127737'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.889764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e225dd11d874817ad1dd515823e2aa8', 'request_id': 'req-cfcb8dad-9ad4-467b-af47-a9329e127737'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.908530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8cc21fbbb64f948ba86e2f1403adcd', 'request_id': 'req-1f505c21-1a56-4c04-835c-3f288b1b8a54'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.917083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8cc21fbbb64f948ba86e2f1403adcd', 'request_id': 'req-1f505c21-1a56-4c04-835c-3f288b1b8a54'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.983681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e225dd11d874817ad1dd515823e2aa8', 'request_id': 'req-cfcb8dad-9ad4-467b-af47-a9329e127737'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.996817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] The token cache is being invalidate because project 1e225dd11d874817ad1dd515823e2aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:10.997498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:10.998924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.001416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 911/1817] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:10 2022] DELETE /identity/v3/projects/1e225dd11d874817ad1dd515823e2aa8 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:11.002479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:11.005243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:11.098656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8cc21fbbb64f948ba86e2f1403adcd', 'request_id': 'req-1f505c21-1a56-4c04-835c-3f288b1b8a54'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.116498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] The token cache is being invalidate because project 7a8cc21fbbb64f948ba86e2f1403adcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:11.118640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.132638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f505c21-1a56-4c04-835c-3f288b1b8a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.134620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 907/1818] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:10 2022] DELETE /identity/v3/projects/7a8cc21fbbb64f948ba86e2f1403adcd => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:11.134863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb8dad-9ad4-467b-af47-a9329e127737 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:11.136648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405744db-2abf-4e91-98f3-26a251365014 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.137200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405744db-2abf-4e91-98f3-26a251365014 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.137734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405744db-2abf-4e91-98f3-26a251365014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.179530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-405744db-2abf-4e91-98f3-26a251365014 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:11.179530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-405744db-2abf-4e91-98f3-26a251365014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:11.255895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:11.256574 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.256855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.257154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] PATH_INFO: `/v3/projects/17be4b249ee7404f854d27861113abb7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.260009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17be4b249ee7404f854d27861113abb7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:11.262400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:11.300940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 908/1819] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:11.300940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405744db-2abf-4e91-98f3-26a251365014 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:11.304316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-405744db-2abf-4e91-98f3-26a251365014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:11.324030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405744db-2abf-4e91-98f3-26a251365014 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:11.335772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:11.337291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.341546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.343071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] PATH_INFO: `/v3/users/945c1ba1e5ba416693bb5c3123c193a5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.345345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=945c1ba1e5ba416693bb5c3123c193a5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:11.352355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:11.431152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17be4b249ee7404f854d27861113abb7', 'request_id': 'req-9be0e584-978a-4497-853f-2ed8b5c56093'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.438089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17be4b249ee7404f854d27861113abb7', 'request_id': 'req-9be0e584-978a-4497-853f-2ed8b5c56093'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.523014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17be4b249ee7404f854d27861113abb7', 'request_id': 'req-9be0e584-978a-4497-853f-2ed8b5c56093'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.545358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] The token cache is being invalidate because project 17be4b249ee7404f854d27861113abb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:11.546089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.549301 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9be0e584-978a-4497-853f-2ed8b5c56093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.568232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 912/1820] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:11 2022] DELETE /identity/v3/projects/17be4b249ee7404f854d27861113abb7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:11.569250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122173a-dd02-44c5-9b3f-61ec69623a29 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.569546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122173a-dd02-44c5-9b3f-61ec69623a29 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.569827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122173a-dd02-44c5-9b3f-61ec69623a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.601871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d122173a-dd02-44c5-9b3f-61ec69623a29 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:11.603109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d122173a-dd02-44c5-9b3f-61ec69623a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:11.604750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945c1ba1e5ba416693bb5c3123c193a5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.606864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945c1ba1e5ba416693bb5c3123c193a5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.607846 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945c1ba1e5ba416693bb5c3123c193a5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.639526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945c1ba1e5ba416693bb5c3123c193a5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.671837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 913/1821] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:11.673274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e3f5-ed40-48ad-9d16-1bd5042b964c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.673559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e3f5-ed40-48ad-9d16-1bd5042b964c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.673831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e3f5-ed40-48ad-9d16-1bd5042b964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.693345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3e01e3f5-ed40-48ad-9d16-1bd5042b964c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:11.694862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3e01e3f5-ed40-48ad-9d16-1bd5042b964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:11.703597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 914/1822] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:11.704186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e3f5-ed40-48ad-9d16-1bd5042b964c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:11.713718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e3f5-ed40-48ad-9d16-1bd5042b964c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:11.718981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9580c2-76ca-4518-adfa-11237a0f75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:11.719592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9580c2-76ca-4518-adfa-11237a0f75c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.719870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9580c2-76ca-4518-adfa-11237a0f75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.720143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9580c2-76ca-4518-adfa-11237a0f75c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.720836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9580c2-76ca-4518-adfa-11237a0f75c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:11.721165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9580c2-76ca-4518-adfa-11237a0f75c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:11.722786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9580c2-76ca-4518-adfa-11237a0f75c5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:11.735098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 915/1823] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:11.736371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb45e-7770-4a4e-9327-b7b1ec9b6d83 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.736666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb45e-7770-4a4e-9327-b7b1ec9b6d83 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.736970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeb45e-7770-4a4e-9327-b7b1ec9b6d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.746060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945c1ba1e5ba416693bb5c3123c193a5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:11.757844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-bbeeb45e-7770-4a4e-9327-b7b1ec9b6d83 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:11.761933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 909/1824] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:11 2022] DELETE /identity/v3/users/945c1ba1e5ba416693bb5c3123c193a5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:11.761933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:11.762205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bbeeb45e-7770-4a4e-9327-b7b1ec9b6d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:11.850422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 916/1825] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:11.855296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeb45e-7770-4a4e-9327-b7b1ec9b6d83 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:11.864084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b703c-abf9-4ac7-9f6a-f0530103b20f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:11.873889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246730ea-2f35-4472-aa4a-0236fd8850a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:11.874676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246730ea-2f35-4472-aa4a-0236fd8850a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.875059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246730ea-2f35-4472-aa4a-0236fd8850a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.876043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246730ea-2f35-4472-aa4a-0236fd8850a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.876822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246730ea-2f35-4472-aa4a-0236fd8850a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:11.878253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeb45e-7770-4a4e-9327-b7b1ec9b6d83 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:11.879025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246730ea-2f35-4472-aa4a-0236fd8850a8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:11.884064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:11.884761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.892261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.892261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.892261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:11.892261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:11.897439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:11.915968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 917/1826] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:11.921092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:11.931808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a98fc-99bb-4168-a484-ec3f760d0d5d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:11.937686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d2bd3-1abf-468d-9724-e3bf002f034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:11.938314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d2bd3-1abf-468d-9724-e3bf002f034c admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:11.938589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d2bd3-1abf-468d-9724-e3bf002f034c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:11.938860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d2bd3-1abf-468d-9724-e3bf002f034c admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:11.939731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d2bd3-1abf-468d-9724-e3bf002f034c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:11.941695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d2bd3-1abf-468d-9724-e3bf002f034c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:11.983575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 910/1827] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:11 2022] POST /identity/v3/projects => generated 393 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:11.986029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246730ea-2f35-4472-aa4a-0236fd8850a8 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.066428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 918/1828] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:11 2022] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:12.068009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d2bd3-1abf-468d-9724-e3bf002f034c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.109995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246730ea-2f35-4472-aa4a-0236fd8850a8 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.175203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:12.180982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d2bd3-1abf-468d-9724-e3bf002f034c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.188652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1853c-3674-4d86-8328-0110a97198ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.189616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1853c-3674-4d86-8328-0110a97198ab admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.190124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1853c-3674-4d86-8328-0110a97198ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.190575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1853c-3674-4d86-8328-0110a97198ab admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.191444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1853c-3674-4d86-8328-0110a97198ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.194978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1853c-3674-4d86-8328-0110a97198ab admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.213174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.214205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.214587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.214979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.216534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.218774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.299754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 919/1829] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:12 2022] POST /identity/v3/users => generated 305 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:12.303763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1853c-3674-4d86-8328-0110a97198ab admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.316765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1853c-3674-4d86-8328-0110a97198ab admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.322390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160506d-a983-4469-a16f-dbc9667c22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.323608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160506d-a983-4469-a16f-dbc9667c22db admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.334847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 911/1830] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:11 2022] POST /identity/v3/users => generated 297 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:12.334990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160506d-a983-4469-a16f-dbc9667c22db admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.335302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160506d-a983-4469-a16f-dbc9667c22db admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.336232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160506d-a983-4469-a16f-dbc9667c22db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.338184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160506d-a983-4469-a16f-dbc9667c22db admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.339564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.343746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:12.370409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca21bd5-0d7d-4bbc-82b3-cf071c6888ae admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.377656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 920/1831] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:12.377656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160506d-a983-4469-a16f-dbc9667c22db admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.388159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.388955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.389145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.389419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] PATH_INFO: `/v3/projects/64fd085d893549debcea847d9dd8936d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.391004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fd085d893549debcea847d9dd8936d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.400779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160506d-a983-4469-a16f-dbc9667c22db admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.401509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.401796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:12.422747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1bd0-4f90-4cfa-bb8e-0ee34e330e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.423429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1bd0-4f90-4cfa-bb8e-0ee34e330e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.423633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1bd0-4f90-4cfa-bb8e-0ee34e330e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.424068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b1bd0-4f90-4cfa-bb8e-0ee34e330e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.424959 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b1bd0-4f90-4cfa-bb8e-0ee34e330e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.426775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b1bd0-4f90-4cfa-bb8e-0ee34e330e41 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.450748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 921/1832] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:12.452106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1bd0-4f90-4cfa-bb8e-0ee34e330e41 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.463498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b1bd0-4f90-4cfa-bb8e-0ee34e330e41 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.470301 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4bb5-dcc2-45a7-9ffc-072e55691e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.470948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4bb5-dcc2-45a7-9ffc-072e55691e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.471224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4bb5-dcc2-45a7-9ffc-072e55691e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.471499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4bb5-dcc2-45a7-9ffc-072e55691e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.472374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb4bb5-dcc2-45a7-9ffc-072e55691e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.485274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb4bb5-dcc2-45a7-9ffc-072e55691e8a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.513635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 922/1833] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:12.514760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4bb5-dcc2-45a7-9ffc-072e55691e8a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.535589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4bb5-dcc2-45a7-9ffc-072e55691e8a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.539847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fd085d893549debcea847d9dd8936d', 'request_id': 'req-721421a3-3e66-46f9-aac6-e03b37cdfc47'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:12.550152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fd085d893549debcea847d9dd8936d', 'request_id': 'req-721421a3-3e66-46f9-aac6-e03b37cdfc47'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:12.624859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3728f1-03fb-4b7c-9251-6c7b5404c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.625699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3728f1-03fb-4b7c-9251-6c7b5404c199 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.626078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3728f1-03fb-4b7c-9251-6c7b5404c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.626450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3728f1-03fb-4b7c-9251-6c7b5404c199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.627249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3728f1-03fb-4b7c-9251-6c7b5404c199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.629307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3728f1-03fb-4b7c-9251-6c7b5404c199 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.648157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 923/1834] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:12.651711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3728f1-03fb-4b7c-9251-6c7b5404c199 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.658543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fd085d893549debcea847d9dd8936d', 'request_id': 'req-721421a3-3e66-46f9-aac6-e03b37cdfc47'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:12.666568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3728f1-03fb-4b7c-9251-6c7b5404c199 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.675195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee2ff7-8427-4bce-814b-6f9ee5cda4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.676027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee2ff7-8427-4bce-814b-6f9ee5cda4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.676954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee2ff7-8427-4bce-814b-6f9ee5cda4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.677350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee2ff7-8427-4bce-814b-6f9ee5cda4e2 admin admin] PATH_INFO: `/v3/projects/a9e63c607ae045f195ba0c7f2ecec9ee/users/4a011d4214814270ad52346143394cf2/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.687365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] The token cache is being invalidate because project 64fd085d893549debcea847d9dd8936d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:12.691422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:12.691422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:12.695088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 912/1835] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:12 2022] DELETE /identity/v3/projects/64fd085d893549debcea847d9dd8936d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:12.695832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:12.697246 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:12.706001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee2ff7-8427-4bce-814b-6f9ee5cda4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e63c607ae045f195ba0c7f2ecec9ee, user_id=4a011d4214814270ad52346143394cf2, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.709842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee2ff7-8427-4bce-814b-6f9ee5cda4e2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.741839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721421a3-3e66-46f9-aac6-e03b37cdfc47 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:12.756667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b1a5c-cca7-4a48-a823-0c9cdc704516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:12.757404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1a5c-cca7-4a48-a823-0c9cdc704516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.758029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1a5c-cca7-4a48-a823-0c9cdc704516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.758029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1a5c-cca7-4a48-a823-0c9cdc704516 admin admin] PATH_INFO: `/v3/projects/9ddb31f56cf340fc8f1e8c322e05839b/users/971dd105cc9f4fe5a74ffafdba4ef8be/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.776692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b1a5c-cca7-4a48-a823-0c9cdc704516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddb31f56cf340fc8f1e8c322e05839b, user_id=971dd105cc9f4fe5a74ffafdba4ef8be, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:12.781880 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b1a5c-cca7-4a48-a823-0c9cdc704516 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:12.800148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 924/1836] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:12 2022] PUT /identity/v3/projects/a9e63c607ae045f195ba0c7f2ecec9ee/users/4a011d4214814270ad52346143394cf2/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:12.800148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2079eb-e7f5-4bdd-97e6-8cc3e7d74a9d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.800148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2079eb-e7f5-4bdd-97e6-8cc3e7d74a9d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.800454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2079eb-e7f5-4bdd-97e6-8cc3e7d74a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.828011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3e2079eb-e7f5-4bdd-97e6-8cc3e7d74a9d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:12.829956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3e2079eb-e7f5-4bdd-97e6-8cc3e7d74a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:12.877778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 913/1837] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:12 2022] PUT /identity/v3/projects/9ddb31f56cf340fc8f1e8c322e05839b/users/971dd105cc9f4fe5a74ffafdba4ef8be/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:12.891123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462e48f-16ce-4705-b6ca-f66acac91107 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:12.891339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462e48f-16ce-4705-b6ca-f66acac91107 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:12.894509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462e48f-16ce-4705-b6ca-f66acac91107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:12.949272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-d462e48f-16ce-4705-b6ca-f66acac91107 None None] MFA Rules not processed for user `4a011d4214814270ad52346143394cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:12.951037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d462e48f-16ce-4705-b6ca-f66acac91107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:13.006674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 925/1838] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:13.012999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006354-1b10-4269-9368-35df1b62a0ff None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.012999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006354-1b10-4269-9368-35df1b62a0ff None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.012999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006354-1b10-4269-9368-35df1b62a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.055096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b4006354-1b10-4269-9368-35df1b62a0ff None None] MFA Rules not processed for user `971dd105cc9f4fe5a74ffafdba4ef8be`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:13.056462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b4006354-1b10-4269-9368-35df1b62a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:13.059151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 914/1839] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:13.061247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbaf41-e466-4ed0-9ad8-112fa3040878 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.061544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbaf41-e466-4ed0-9ad8-112fa3040878 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.061826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbaf41-e466-4ed0-9ad8-112fa3040878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.085115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-79dbaf41-e466-4ed0-9ad8-112fa3040878 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:13.086359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-79dbaf41-e466-4ed0-9ad8-112fa3040878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:13.141759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 926/1840] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:13.146272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4006354-1b10-4269-9368-35df1b62a0ff None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.154191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b4006354-1b10-4269-9368-35df1b62a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:13.167380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 915/1841] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:13.168458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbaf41-e466-4ed0-9ad8-112fa3040878 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.183461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbaf41-e466-4ed0-9ad8-112fa3040878 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.191059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd819-755b-4f96-abca-e863da4a8bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.191695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd819-755b-4f96-abca-e863da4a8bec admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.191978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd819-755b-4f96-abca-e863da4a8bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.192282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd819-755b-4f96-abca-e863da4a8bec admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.193054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd819-755b-4f96-abca-e863da4a8bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.195040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd819-755b-4f96-abca-e863da4a8bec admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.264782 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4006354-1b10-4269-9368-35df1b62a0ff None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.274497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d02986-f409-4559-a1a0-1a714e5c64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.275141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d02986-f409-4559-a1a0-1a714e5c64a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.275425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d02986-f409-4559-a1a0-1a714e5c64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.275725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d02986-f409-4559-a1a0-1a714e5c64a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.276637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d02986-f409-4559-a1a0-1a714e5c64a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.279559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d02986-f409-4559-a1a0-1a714e5c64a1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.331717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 916/1842] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:13 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:13.333272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd819-755b-4f96-abca-e863da4a8bec admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.393428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 927/1843] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:13 2022] POST /identity/v3/projects => generated 407 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:13.395924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c542b-1716-408d-a736-9451635c4e6a None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.396440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c542b-1716-408d-a736-9451635c4e6a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.397015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c542b-1716-408d-a736-9451635c4e6a None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.400427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 928/1844] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:25:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:25:13.401597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c542b-1716-408d-a736-9451635c4e6a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.468473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd819-755b-4f96-abca-e863da4a8bec admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.533165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c542b-1716-408d-a736-9451635c4e6a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.538544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef079e-f593-4308-ae11-222c943289c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.539317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef079e-f593-4308-ae11-222c943289c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.539628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef079e-f593-4308-ae11-222c943289c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.539895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef079e-f593-4308-ae11-222c943289c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.540569 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef079e-f593-4308-ae11-222c943289c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.542739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef079e-f593-4308-ae11-222c943289c6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.551517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.552199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.552580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.552921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.553537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:13.553843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.555558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.568727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 917/1845] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:13.569457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.581968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9bb61-b8bd-4ace-810e-b1e93b0102ba admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.587058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b48a65-abac-48a4-8963-e199597ab6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.587673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48a65-abac-48a4-8963-e199597ab6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.587945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48a65-abac-48a4-8963-e199597ab6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.588418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48a65-abac-48a4-8963-e199597ab6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.589106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b48a65-abac-48a4-8963-e199597ab6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.592373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b48a65-abac-48a4-8963-e199597ab6c7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.603960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:13.672072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 929/1846] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:13 2022] POST /identity/v3/users => generated 303 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:13.673863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c745d44-06e2-48f2-95ec-564c38cbb55c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.674254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c745d44-06e2-48f2-95ec-564c38cbb55c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.674633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c745d44-06e2-48f2-95ec-564c38cbb55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.697402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9c745d44-06e2-48f2-95ec-564c38cbb55c None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:13.698701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9c745d44-06e2-48f2-95ec-564c38cbb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:13.701767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 918/1847] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:13 2022] POST /identity/v3/users => generated 310 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:13.702667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b48a65-abac-48a4-8963-e199597ab6c7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.713313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b48a65-abac-48a4-8963-e199597ab6c7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.720290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.721198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.721534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.721857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.723237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.725462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.783546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 930/1848] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:25:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:13.784706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c745d44-06e2-48f2-95ec-564c38cbb55c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.809646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c745d44-06e2-48f2-95ec-564c38cbb55c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.809646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32480cf-a21f-4def-941e-4ab25e73e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.809646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32480cf-a21f-4def-941e-4ab25e73e82c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.809646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32480cf-a21f-4def-941e-4ab25e73e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.809972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32480cf-a21f-4def-941e-4ab25e73e82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.809972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32480cf-a21f-4def-941e-4ab25e73e82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.810283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32480cf-a21f-4def-941e-4ab25e73e82c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.821366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 931/1849] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:13.822376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32480cf-a21f-4def-941e-4ab25e73e82c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.832412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32480cf-a21f-4def-941e-4ab25e73e82c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.837603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696466d3-934b-4eb3-a208-190bbf787b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.838404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696466d3-934b-4eb3-a208-190bbf787b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.838598 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696466d3-934b-4eb3-a208-190bbf787b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.838881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696466d3-934b-4eb3-a208-190bbf787b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.839585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696466d3-934b-4eb3-a208-190bbf787b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.841282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696466d3-934b-4eb3-a208-190bbf787b13 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.850258 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 919/1850] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:13 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:13.854207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 932/1851] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:13.854207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696466d3-934b-4eb3-a208-190bbf787b13 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.857037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:13.859630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:13.865058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696466d3-934b-4eb3-a208-190bbf787b13 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.933225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80461a2-e2cf-45aa-a409-250a8308054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.933906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80461a2-e2cf-45aa-a409-250a8308054f admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.934878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80461a2-e2cf-45aa-a409-250a8308054f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.935155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80461a2-e2cf-45aa-a409-250a8308054f admin admin] PATH_INFO: `/v3/projects/842c889f5f344dfc8f4ff632726703fe/users/258b47f893424423a951ddb276f24a41/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.950941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80461a2-e2cf-45aa-a409-250a8308054f admin admin] RBAC: Authorizing `identity:create_grant(project_id=842c889f5f344dfc8f4ff632726703fe, user_id=258b47f893424423a951ddb276f24a41, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.954373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80461a2-e2cf-45aa-a409-250a8308054f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:13.972535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b90a-98ad-4405-8352-36d3996046cd admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:13.978825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9457-6f6e-4139-b7d7-5e383c1ad02a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:13.979385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9457-6f6e-4139-b7d7-5e383c1ad02a service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:13.979652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9457-6f6e-4139-b7d7-5e383c1ad02a service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:13.980225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9457-6f6e-4139-b7d7-5e383c1ad02a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:13.991336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf9457-6f6e-4139-b7d7-5e383c1ad02a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:13.994817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf9457-6f6e-4139-b7d7-5e383c1ad02a service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.000103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:14.007717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 920/1852] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:14.007964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9457-6f6e-4139-b7d7-5e383c1ad02a service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.019247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9457-6f6e-4139-b7d7-5e383c1ad02a service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.025479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8071295-049c-42c8-9697-7d913413c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.026102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8071295-049c-42c8-9697-7d913413c8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.026382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8071295-049c-42c8-9697-7d913413c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.026654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8071295-049c-42c8-9697-7d913413c8ad admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.027527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8071295-049c-42c8-9697-7d913413c8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.031565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8071295-049c-42c8-9697-7d913413c8ad admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.078593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 933/1853] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:13 2022] PUT /identity/v3/projects/842c889f5f344dfc8f4ff632726703fe/users/258b47f893424423a951ddb276f24a41/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:14.080635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80461a2-e2cf-45aa-a409-250a8308054f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.135167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 921/1854] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:14 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:14.136483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8071295-049c-42c8-9697-7d913413c8ad admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.152120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8071295-049c-42c8-9697-7d913413c8ad admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.159964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4a4e-c285-4993-9392-9d0e30173f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.160912 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4a4e-c285-4993-9392-9d0e30173f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.161495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4a4e-c285-4993-9392-9d0e30173f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.161869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4a4e-c285-4993-9392-9d0e30173f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.162238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80461a2-e2cf-45aa-a409-250a8308054f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.162795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d4a4e-c285-4993-9392-9d0e30173f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.165565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d4a4e-c285-4993-9392-9d0e30173f9e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.173178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb06bd-544d-431c-802a-7dffc2f6bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.173980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb06bd-544d-431c-802a-7dffc2f6bf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.177246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb06bd-544d-431c-802a-7dffc2f6bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.177246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb06bd-544d-431c-802a-7dffc2f6bf6c admin admin] PATH_INFO: `/v3/projects/0f1baf4bbece4f3aac8839ad55abf818/users/1e01eb8305df451ca8d81c149b628bcc/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.183225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 922/1855] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:14.183225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4a4e-c285-4993-9392-9d0e30173f9e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.197231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4a4e-c285-4993-9392-9d0e30173f9e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.206459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb06bd-544d-431c-802a-7dffc2f6bf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1baf4bbece4f3aac8839ad55abf818, user_id=1e01eb8305df451ca8d81c149b628bcc, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.206459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb06bd-544d-431c-802a-7dffc2f6bf6c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.209203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff9b2-f216-491d-a07a-32a7ede40205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.210073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff9b2-f216-491d-a07a-32a7ede40205 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.210350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff9b2-f216-491d-a07a-32a7ede40205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.210624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aff9b2-f216-491d-a07a-32a7ede40205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.211380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aff9b2-f216-491d-a07a-32a7ede40205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.213236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aff9b2-f216-491d-a07a-32a7ede40205 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.236205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 923/1856] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:14.236205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff9b2-f216-491d-a07a-32a7ede40205 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.245937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aff9b2-f216-491d-a07a-32a7ede40205 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.251640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41c022-cea4-47d9-af69-84ce7dc34d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.252245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c022-cea4-47d9-af69-84ce7dc34d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.252520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c022-cea4-47d9-af69-84ce7dc34d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.252794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c022-cea4-47d9-af69-84ce7dc34d34 admin admin] PATH_INFO: `/v3/projects/842c889f5f344dfc8f4ff632726703fe/users/258b47f893424423a951ddb276f24a41/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.254786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41c022-cea4-47d9-af69-84ce7dc34d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842c889f5f344dfc8f4ff632726703fe, user_id=258b47f893424423a951ddb276f24a41, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.257464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41c022-cea4-47d9-af69-84ce7dc34d34 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.268851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 924/1857] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:14 2022] PUT /identity/v3/projects/842c889f5f344dfc8f4ff632726703fe/users/258b47f893424423a951ddb276f24a41/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:14.269792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41c022-cea4-47d9-af69-84ce7dc34d34 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.311027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 934/1858] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:14 2022] PUT /identity/v3/projects/0f1baf4bbece4f3aac8839ad55abf818/users/1e01eb8305df451ca8d81c149b628bcc/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:14.312328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8096de-8843-4d80-9fa0-14a057ecf85a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.312625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8096de-8843-4d80-9fa0-14a057ecf85a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.312918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8096de-8843-4d80-9fa0-14a057ecf85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.334218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41c022-cea4-47d9-af69-84ce7dc34d34 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.347822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-0c8096de-8843-4d80-9fa0-14a057ecf85a None None] MFA Rules not processed for user `258b47f893424423a951ddb276f24a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:14.349177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0c8096de-8843-4d80-9fa0-14a057ecf85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:14.399981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996d2de-0a97-4b53-9289-17c330b14c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.400638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996d2de-0a97-4b53-9289-17c330b14c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.400958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996d2de-0a97-4b53-9289-17c330b14c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.401240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996d2de-0a97-4b53-9289-17c330b14c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.401961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996d2de-0a97-4b53-9289-17c330b14c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.403615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996d2de-0a97-4b53-9289-17c330b14c06 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.414322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 925/1859] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:14.414995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996d2de-0a97-4b53-9289-17c330b14c06 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.431463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996d2de-0a97-4b53-9289-17c330b14c06 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.431917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 935/1860] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:14.432877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8096de-8843-4d80-9fa0-14a057ecf85a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.438254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.441629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.441629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.441629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.441629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.442230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.452302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8096de-8843-4d80-9fa0-14a057ecf85a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.458041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.458731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.459067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.459348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] PATH_INFO: `/v3/projects/42fa6adc81af4f5cbe3fd91f2f3cd6ce/users/e6aa6f2499e94529ad4fef4924d1f1ab/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.460516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 926/1861] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:14.461125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.463135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:14.483962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fa6adc81af4f5cbe3fd91f2f3cd6ce, user_id=e6aa6f2499e94529ad4fef4924d1f1ab, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.486771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.538029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e82a2-dabe-451a-91c1-25862a7c6533 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.544216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2909b-f878-4e20-b7ba-a83fe9c2614d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.544860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2909b-f878-4e20-b7ba-a83fe9c2614d service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.549013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2909b-f878-4e20-b7ba-a83fe9c2614d service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.549340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2909b-f878-4e20-b7ba-a83fe9c2614d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.561894 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2909b-f878-4e20-b7ba-a83fe9c2614d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.563256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2909b-f878-4e20-b7ba-a83fe9c2614d service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.574096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 927/1862] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:14 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:14.574965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2909b-f878-4e20-b7ba-a83fe9c2614d service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.585656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2909b-f878-4e20-b7ba-a83fe9c2614d service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.595024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5b2e7-a71d-4444-8155-223c82479c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.596119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b2e7-a71d-4444-8155-223c82479c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.596119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b2e7-a71d-4444-8155-223c82479c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.596318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5b2e7-a71d-4444-8155-223c82479c96 admin admin] PATH_INFO: `/v3/projects/0f1baf4bbece4f3aac8839ad55abf818/users/1e01eb8305df451ca8d81c149b628bcc/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.598299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5b2e7-a71d-4444-8155-223c82479c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1baf4bbece4f3aac8839ad55abf818, user_id=1e01eb8305df451ca8d81c149b628bcc, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.602312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5b2e7-a71d-4444-8155-223c82479c96 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.628362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 928/1863] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:14 2022] PUT /identity/v3/projects/0f1baf4bbece4f3aac8839ad55abf818/users/1e01eb8305df451ca8d81c149b628bcc/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:14.634258 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca6bd-3e1c-442a-83d0-5194f6b8ab02 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.634629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca6bd-3e1c-442a-83d0-5194f6b8ab02 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.634974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbca6bd-3e1c-442a-83d0-5194f6b8ab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.639486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 936/1864] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:14 2022] PUT /identity/v3/projects/42fa6adc81af4f5cbe3fd91f2f3cd6ce/users/e6aa6f2499e94529ad4fef4924d1f1ab/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:14.640473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.642479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:14.668232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7fbca6bd-3e1c-442a-83d0-5194f6b8ab02 None None] MFA Rules not processed for user `1e01eb8305df451ca8d81c149b628bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:14.679918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7fbca6bd-3e1c-442a-83d0-5194f6b8ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:14.714769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccd26b-11a3-4232-937b-450c3cf38ade admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.718903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a216e-60e8-4d15-8368-c9f4c09cc7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.719536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a216e-60e8-4d15-8368-c9f4c09cc7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.719823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a216e-60e8-4d15-8368-c9f4c09cc7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.720094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a216e-60e8-4d15-8368-c9f4c09cc7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.748937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 929/1865] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:14.750363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c87e-1e46-49e9-bf39-1e00d0daed58 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.750702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c87e-1e46-49e9-bf39-1e00d0daed58 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.751029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c87e-1e46-49e9-bf39-1e00d0daed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.771534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9590c87e-1e46-49e9-bf39-1e00d0daed58 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:14.773117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9590c87e-1e46-49e9-bf39-1e00d0daed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:14.783112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a216e-60e8-4d15-8368-c9f4c09cc7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.784618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a216e-60e8-4d15-8368-c9f4c09cc7c0 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.794308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 937/1866] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:14.794899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a216e-60e8-4d15-8368-c9f4c09cc7c0 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.802945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a216e-60e8-4d15-8368-c9f4c09cc7c0 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:14.807258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:14.807844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:14.808264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:14.808490 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:14.831126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:14.832591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:14.855556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 938/1867] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:14 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:14.889450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 930/1868] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:14.894725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:14.896901 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:15.000275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee394e9-3a42-4147-b0bb-c08e74699138 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:15.005891 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea138d2-fe0a-4fec-929c-6d9c7b3d4055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:15.006823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea138d2-fe0a-4fec-929c-6d9c7b3d4055 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:15.007109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea138d2-fe0a-4fec-929c-6d9c7b3d4055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:15.007386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea138d2-fe0a-4fec-929c-6d9c7b3d4055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:15.021267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea138d2-fe0a-4fec-929c-6d9c7b3d4055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:15.023097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea138d2-fe0a-4fec-929c-6d9c7b3d4055 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:15.035333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 939/1869] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:15.350492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590c87e-1e46-49e9-bf39-1e00d0daed58 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:15.361546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590c87e-1e46-49e9-bf39-1e00d0daed58 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:15.365375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258d401-0e15-434d-b6cd-3efa28648431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:15.366003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d401-0e15-434d-b6cd-3efa28648431 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:15.366285 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d401-0e15-434d-b6cd-3efa28648431 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:15.366557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d401-0e15-434d-b6cd-3efa28648431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:15.435373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258d401-0e15-434d-b6cd-3efa28648431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:15.437030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258d401-0e15-434d-b6cd-3efa28648431 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:15.493637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 931/1870] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:15 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:18.028397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3191f8-0c3b-43fe-815f-419ce20475f6 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:18.028987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3191f8-0c3b-43fe-815f-419ce20475f6 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:18.029499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3191f8-0c3b-43fe-815f-419ce20475f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:18.065021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3c3191f8-0c3b-43fe-815f-419ce20475f6 None None] MFA Rules not processed for user `e6aa6f2499e94529ad4fef4924d1f1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:18.066477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3c3191f8-0c3b-43fe-815f-419ce20475f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:18.167456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 940/1871] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:18.168100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258d401-0e15-434d-b6cd-3efa28648431 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:18.182159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258d401-0e15-434d-b6cd-3efa28648431 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:18.205265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011c97-e6a5-4c22-9698-51db1a4dc0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:18.206037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011c97-e6a5-4c22-9698-51db1a4dc0df admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:18.206761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011c97-e6a5-4c22-9698-51db1a4dc0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:18.206761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011c97-e6a5-4c22-9698-51db1a4dc0df admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:18.207254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f011c97-e6a5-4c22-9698-51db1a4dc0df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:18.209395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f011c97-e6a5-4c22-9698-51db1a4dc0df admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:18.304611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 932/1872] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:18 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:18.309321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3191f8-0c3b-43fe-815f-419ce20475f6 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:18.327463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3191f8-0c3b-43fe-815f-419ce20475f6 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:18.399249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db833d2e-788a-41b7-92af-04fdc8a84127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:18.399905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db833d2e-788a-41b7-92af-04fdc8a84127 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:18.400195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db833d2e-788a-41b7-92af-04fdc8a84127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:18.400457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db833d2e-788a-41b7-92af-04fdc8a84127 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:18.401247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db833d2e-788a-41b7-92af-04fdc8a84127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:18.403848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db833d2e-788a-41b7-92af-04fdc8a84127 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:18.557729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 941/1873] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:18 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:18.564373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011c97-e6a5-4c22-9698-51db1a4dc0df admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:18.588989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011c97-e6a5-4c22-9698-51db1a4dc0df admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:18.607790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:18.609593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936de5ae-1c8b-41e6-b787-c9461535c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:18.611081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936de5ae-1c8b-41e6-b787-c9461535c317 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:18.611654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936de5ae-1c8b-41e6-b787-c9461535c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:18.612236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936de5ae-1c8b-41e6-b787-c9461535c317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:18.613710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936de5ae-1c8b-41e6-b787-c9461535c317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:18.616249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936de5ae-1c8b-41e6-b787-c9461535c317 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:18.634325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 933/1874] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:18.638099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db833d2e-788a-41b7-92af-04fdc8a84127 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:18.651403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db833d2e-788a-41b7-92af-04fdc8a84127 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:18.656912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd67a7-d59a-481d-ae0a-79899600c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:18.657993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd67a7-d59a-481d-ae0a-79899600c5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:18.658250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd67a7-d59a-481d-ae0a-79899600c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:18.658529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd67a7-d59a-481d-ae0a-79899600c5f2 admin admin] PATH_INFO: `/v3/projects/28b0d1dc33f54cb7b3a5ae923f335f58/users/b4de9da5c75f4763bc8e37419f04c053/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:18.677503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd67a7-d59a-481d-ae0a-79899600c5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b0d1dc33f54cb7b3a5ae923f335f58, user_id=b4de9da5c75f4763bc8e37419f04c053, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:18.680380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd67a7-d59a-481d-ae0a-79899600c5f2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:18.786012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 942/1875] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:18 2022] PUT /identity/v3/projects/28b0d1dc33f54cb7b3a5ae923f335f58/users/b4de9da5c75f4763bc8e37419f04c053/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:18.790176 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936de5ae-1c8b-41e6-b787-c9461535c317 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:18.801806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936de5ae-1c8b-41e6-b787-c9461535c317 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:18.865691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:18.875948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a2be5-6aaa-40b6-8373-2054c439b4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:18.876980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2be5-6aaa-40b6-8373-2054c439b4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:18.877354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2be5-6aaa-40b6-8373-2054c439b4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:18.877631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2be5-6aaa-40b6-8373-2054c439b4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:18.878910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a2be5-6aaa-40b6-8373-2054c439b4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:18.881718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a2be5-6aaa-40b6-8373-2054c439b4cd admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:18.894746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 934/1876] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:18.899281 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd67a7-d59a-481d-ae0a-79899600c5f2 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:18.912055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd67a7-d59a-481d-ae0a-79899600c5f2 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:18.916788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1defdb1-6555-4bb1-a6f6-8738fa613487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:18.917499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1defdb1-6555-4bb1-a6f6-8738fa613487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:18.917830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1defdb1-6555-4bb1-a6f6-8738fa613487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:18.918108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1defdb1-6555-4bb1-a6f6-8738fa613487 admin admin] PATH_INFO: `/v3/projects/28b0d1dc33f54cb7b3a5ae923f335f58/users/b4de9da5c75f4763bc8e37419f04c053/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:18.920741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1defdb1-6555-4bb1-a6f6-8738fa613487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b0d1dc33f54cb7b3a5ae923f335f58, user_id=b4de9da5c75f4763bc8e37419f04c053, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:18.923499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1defdb1-6555-4bb1-a6f6-8738fa613487 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:18.935681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 943/1877] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:18 2022] PUT /identity/v3/projects/28b0d1dc33f54cb7b3a5ae923f335f58/users/b4de9da5c75f4763bc8e37419f04c053/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:20.572240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ee430-6504-42f8-aa40-3ca391922877 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:20.572742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ee430-6504-42f8-aa40-3ca391922877 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:20.572854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ee430-6504-42f8-aa40-3ca391922877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:20.610190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-da6ee430-6504-42f8-aa40-3ca391922877 None None] MFA Rules not processed for user `b4de9da5c75f4763bc8e37419f04c053`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:20.611824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-da6ee430-6504-42f8-aa40-3ca391922877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:20.664945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:20.749843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 935/1878] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:20.771159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f263f5-1654-452e-9dec-d4a5ae28bae4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:20.771474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f263f5-1654-452e-9dec-d4a5ae28bae4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:20.771794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f263f5-1654-452e-9dec-d4a5ae28bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:20.803250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-61f263f5-1654-452e-9dec-d4a5ae28bae4 None None] MFA Rules not processed for user `e6aa6f2499e94529ad4fef4924d1f1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:20.804653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-61f263f5-1654-452e-9dec-d4a5ae28bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:20.873816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 944/1879] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:20.884582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ee430-6504-42f8-aa40-3ca391922877 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:20.886184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-da6ee430-6504-42f8-aa40-3ca391922877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:20.975758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ee430-6504-42f8-aa40-3ca391922877 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:20.985055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6f60c-1ea1-4b0a-8421-89720fa1b922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:20.985055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f60c-1ea1-4b0a-8421-89720fa1b922 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:20.985055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f60c-1ea1-4b0a-8421-89720fa1b922 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:20.985055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f60c-1ea1-4b0a-8421-89720fa1b922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:20.994439 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6f60c-1ea1-4b0a-8421-89720fa1b922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:20.997128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6f60c-1ea1-4b0a-8421-89720fa1b922 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:21.007830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 936/1880] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:21.344335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f263f5-1654-452e-9dec-d4a5ae28bae4 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:21.415812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f263f5-1654-452e-9dec-d4a5ae28bae4 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:21.421309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:21.421955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:21.422232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:21.422505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] PATH_INFO: `/v3/users/971dd105cc9f4fe5a74ffafdba4ef8be` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:21.423680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971dd105cc9f4fe5a74ffafdba4ef8be)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:21.425632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:21.854826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971dd105cc9f4fe5a74ffafdba4ef8be'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:21.864157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971dd105cc9f4fe5a74ffafdba4ef8be'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:21.995920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971dd105cc9f4fe5a74ffafdba4ef8be'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:22.016729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971dd105cc9f4fe5a74ffafdba4ef8be'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:22.017810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971dd105cc9f4fe5a74ffafdba4ef8be'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:22.026960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 945/1881] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:21 2022] DELETE /identity/v3/users/971dd105cc9f4fe5a74ffafdba4ef8be => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:22.035226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fddc-50c7-474b-8287-da8d65d93ca1 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:22.036397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fddc-50c7-474b-8287-da8d65d93ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:22.036753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fddc-50c7-474b-8287-da8d65d93ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:22.046236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:22.066164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cde0fddc-50c7-474b-8287-da8d65d93ca1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:22.069396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cde0fddc-50c7-474b-8287-da8d65d93ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:22.179799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 937/1882] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:22.190360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:22.191842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:22.308018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a8813-8847-40e4-b790-28d552ed9b18 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:22.313152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a05501-959d-4c6d-8b23-d072db602ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:22.313816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a05501-959d-4c6d-8b23-d072db602ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:22.314094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a05501-959d-4c6d-8b23-d072db602ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:22.314368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a05501-959d-4c6d-8b23-d072db602ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:22.325332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a05501-959d-4c6d-8b23-d072db602ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:22.327475 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a05501-959d-4c6d-8b23-d072db602ce9 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:22.337531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 946/1883] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:22.820856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fddc-50c7-474b-8287-da8d65d93ca1 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:22.823394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cde0fddc-50c7-474b-8287-da8d65d93ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:22.876375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fddc-50c7-474b-8287-da8d65d93ca1 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:22.887222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:22.888090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:22.888450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:22.888726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] PATH_INFO: `/v3/projects/9ddb31f56cf340fc8f1e8c322e05839b` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:22.891129 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ddb31f56cf340fc8f1e8c322e05839b)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:22.893267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:23.056721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ddb31f56cf340fc8f1e8c322e05839b', 'request_id': 'req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.063306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ddb31f56cf340fc8f1e8c322e05839b', 'request_id': 'req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.150424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ddb31f56cf340fc8f1e8c322e05839b', 'request_id': 'req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.177742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] The token cache is being invalidate because project 9ddb31f56cf340fc8f1e8c322e05839b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:23.177742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.178650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.180273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 938/1884] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:22 2022] DELETE /identity/v3/projects/9ddb31f56cf340fc8f1e8c322e05839b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:23.184647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a05501-959d-4c6d-8b23-d072db602ce9 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:23.195968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a05501-959d-4c6d-8b23-d072db602ce9 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:23.270232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:23.270892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:23.271387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:23.271665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] PATH_INFO: `/v3/users/258b47f893424423a951ddb276f24a41` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:23.275529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=258b47f893424423a951ddb276f24a41)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:23.277530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:23.519645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258b47f893424423a951ddb276f24a41'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.528296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258b47f893424423a951ddb276f24a41'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.648109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258b47f893424423a951ddb276f24a41'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.663896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258b47f893424423a951ddb276f24a41'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.664602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-abfdb56e-6967-41c4-9260-8bc150e23d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258b47f893424423a951ddb276f24a41'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:23.679076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 947/1885] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:23 2022] DELETE /identity/v3/users/258b47f893424423a951ddb276f24a41 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:23.814019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:24.359772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:24.361144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:24.384610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd2d53-0d8a-4f0f-a283-61a16f02c0a8 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:24.570667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:24.573631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:24.573913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:24.574188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] PATH_INFO: `/v3/users/4a011d4214814270ad52346143394cf2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:24.581211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a011d4214814270ad52346143394cf2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:24.585972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:24.878492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a011d4214814270ad52346143394cf2'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:24.879639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a011d4214814270ad52346143394cf2'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:24.880589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a011d4214814270ad52346143394cf2'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:24.898025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a011d4214814270ad52346143394cf2'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:24.983276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a011d4214814270ad52346143394cf2'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:25.011678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 939/1886] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:24 2022] DELETE /identity/v3/users/4a011d4214814270ad52346143394cf2 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:25.015213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f00f-0a7e-4519-a4d1-2c43f2edc4a5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:25.015820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f00f-0a7e-4519-a4d1-2c43f2edc4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:25.016342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7f00f-0a7e-4519-a4d1-2c43f2edc4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:25.048773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1bb7f00f-0a7e-4519-a4d1-2c43f2edc4a5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:25.050461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1bb7f00f-0a7e-4519-a4d1-2c43f2edc4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:25.147749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 948/1887] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:25.160830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:25.163044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:25.181710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7f00f-0a7e-4519-a4d1-2c43f2edc4a5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:25.183633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1bb7f00f-0a7e-4519-a4d1-2c43f2edc4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:25.218723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7f00f-0a7e-4519-a4d1-2c43f2edc4a5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:25.225556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:25.226231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:25.226507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:25.226784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] PATH_INFO: `/v3/projects/842c889f5f344dfc8f4ff632726703fe` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:25.228732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=842c889f5f344dfc8f4ff632726703fe)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:25.232039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:25.258376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d73b3-9592-4756-af66-645b0cd962f7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:25.262830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ac77a-972b-4556-848c-3d8f62278c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:25.263753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac77a-972b-4556-848c-3d8f62278c9e service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:25.264137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac77a-972b-4556-848c-3d8f62278c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:25.264515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac77a-972b-4556-848c-3d8f62278c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:25.283735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ac77a-972b-4556-848c-3d8f62278c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:25.285319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ac77a-972b-4556-848c-3d8f62278c9e service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:25.298953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 940/1888] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:25.412483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842c889f5f344dfc8f4ff632726703fe', 'request_id': 'req-6f54b843-d4e9-41cc-8676-175983f2d4b5'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:25.435666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842c889f5f344dfc8f4ff632726703fe', 'request_id': 'req-6f54b843-d4e9-41cc-8676-175983f2d4b5'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:25.469170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:25.527127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842c889f5f344dfc8f4ff632726703fe', 'request_id': 'req-6f54b843-d4e9-41cc-8676-175983f2d4b5'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:25.543607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] The token cache is being invalidate because project 842c889f5f344dfc8f4ff632726703fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:25.543928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:25.545682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6f54b843-d4e9-41cc-8676-175983f2d4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:25.547768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 949/1889] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:25 2022] DELETE /identity/v3/projects/842c889f5f344dfc8f4ff632726703fe => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:25.552843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9787-91ef-4290-8b6f-5db05d9cc192 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:25.553159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9787-91ef-4290-8b6f-5db05d9cc192 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:25.553484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9787-91ef-4290-8b6f-5db05d9cc192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:25.592669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-99ca9787-91ef-4290-8b6f-5db05d9cc192 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:25.597374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-99ca9787-91ef-4290-8b6f-5db05d9cc192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:25.764747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 941/1890] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:25.770235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488ad5-4c86-4f81-9bc4-570c04ab87b2 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:25.770530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488ad5-4c86-4f81-9bc4-570c04ab87b2 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:25.770805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488ad5-4c86-4f81-9bc4-570c04ab87b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:25.797861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-49488ad5-4c86-4f81-9bc4-570c04ab87b2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:25.799521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-49488ad5-4c86-4f81-9bc4-570c04ab87b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:25.816993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 950/1891] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:25.818944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9787-91ef-4290-8b6f-5db05d9cc192 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:25.853532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9787-91ef-4290-8b6f-5db05d9cc192 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:25.863649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:25.864948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:25.864948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:25.869704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:25.869704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:25.869704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:25.869704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:25.888632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 942/1892] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:25:25.890476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49488ad5-4c86-4f81-9bc4-570c04ab87b2 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:25.911692 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49488ad5-4c86-4f81-9bc4-570c04ab87b2 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:25.927479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:25.930899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:25.930899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:25.930899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:25.930899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:25.936291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:26.059804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 951/1893] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:25 2022] POST /identity/v3/projects => generated 399 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:26.061388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:26.075623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e1f3-4b05-4ef6-837d-7436397c35db admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:26.167933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36685d29-ee8d-4601-8ee3-89348ed9c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:26.167933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685d29-ee8d-4601-8ee3-89348ed9c29a admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:26.167933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685d29-ee8d-4601-8ee3-89348ed9c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:26.167933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36685d29-ee8d-4601-8ee3-89348ed9c29a admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:26.168215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36685d29-ee8d-4601-8ee3-89348ed9c29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:26.169944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:26.171315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:26.174047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36685d29-ee8d-4601-8ee3-89348ed9c29a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:26.200642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3ac5-5993-4b19-ac85-dc81ef766631 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:26.252873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:26.253571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:26.253851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:26.254124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] PATH_INFO: `/v3/projects/a9e63c607ae045f195ba0c7f2ecec9ee` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:26.256285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e63c607ae045f195ba0c7f2ecec9ee)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:26.258249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:26.320801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 943/1894] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:26 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:26.325363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36685d29-ee8d-4601-8ee3-89348ed9c29a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:26.344188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36685d29-ee8d-4601-8ee3-89348ed9c29a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:26.352743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e884a-9027-4c5b-ab62-b8d6ea7a9d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:26.353544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e884a-9027-4c5b-ab62-b8d6ea7a9d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:26.357219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e884a-9027-4c5b-ab62-b8d6ea7a9d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:26.357583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e884a-9027-4c5b-ab62-b8d6ea7a9d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:26.358535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e884a-9027-4c5b-ab62-b8d6ea7a9d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:26.360340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e884a-9027-4c5b-ab62-b8d6ea7a9d12 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:26.381224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 944/1895] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:26.383840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e884a-9027-4c5b-ab62-b8d6ea7a9d12 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:26.398232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e884a-9027-4c5b-ab62-b8d6ea7a9d12 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:26.421027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e63c607ae045f195ba0c7f2ecec9ee', 'request_id': 'req-4157a7ee-7d58-4381-8436-b428bef4916f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:26.427855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e63c607ae045f195ba0c7f2ecec9ee', 'request_id': 'req-4157a7ee-7d58-4381-8436-b428bef4916f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:26.474475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:26.475236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:26.475580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:26.475940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:26.476795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:26.479262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:26.481833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e63c607ae045f195ba0c7f2ecec9ee', 'request_id': 'req-4157a7ee-7d58-4381-8436-b428bef4916f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:26.508135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] The token cache is being invalidate because project a9e63c607ae045f195ba0c7f2ecec9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:26.508559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:26.509710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:26.514886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 952/1896] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:26 2022] DELETE /identity/v3/projects/a9e63c607ae045f195ba0c7f2ecec9ee => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:26.519092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:26.527291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 945/1897] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:26.527770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:26.530494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:26.534497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:26.542773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a7ee-7d58-4381-8436-b428bef4916f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:26.548668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:26.549456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:26.549745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:26.550181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] PATH_INFO: `/v3/users/1e01eb8305df451ca8d81c149b628bcc` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:26.551356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e01eb8305df451ca8d81c149b628bcc)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:26.553030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074315-8a23-44c5-96e2-5e18e0c97cca admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:26.553345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:26.561837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bf906-0a55-4be0-8c1d-d7d761a26e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:26.562641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf906-0a55-4be0-8c1d-d7d761a26e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:26.563026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf906-0a55-4be0-8c1d-d7d761a26e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:26.563817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf906-0a55-4be0-8c1d-d7d761a26e93 admin admin] PATH_INFO: `/v3/projects/107e80ddb7fc4d29aefc45d5f908a5e8/users/03d4eb3277d4462783babf09b61f4b97/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:26.588726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bf906-0a55-4be0-8c1d-d7d761a26e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107e80ddb7fc4d29aefc45d5f908a5e8, user_id=03d4eb3277d4462783babf09b61f4b97, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:26.592412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bf906-0a55-4be0-8c1d-d7d761a26e93 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:26.693573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:26.700496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 946/1898] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:26 2022] PUT /identity/v3/projects/107e80ddb7fc4d29aefc45d5f908a5e8/users/03d4eb3277d4462783babf09b61f4b97/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:26.711971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d7868-0d34-4ca5-80c5-a010353e1a02 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:26.712381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d7868-0d34-4ca5-80c5-a010353e1a02 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:26.712728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d7868-0d34-4ca5-80c5-a010353e1a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:26.747092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-771d7868-0d34-4ca5-80c5-a010353e1a02 None None] MFA Rules not processed for user `03d4eb3277d4462783babf09b61f4b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:26.748811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-771d7868-0d34-4ca5-80c5-a010353e1a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:26.835208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e01eb8305df451ca8d81c149b628bcc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:26.870235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e01eb8305df451ca8d81c149b628bcc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:26.909960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 947/1899] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:26.915155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d7868-0d34-4ca5-80c5-a010353e1a02 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:27.001030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d7868-0d34-4ca5-80c5-a010353e1a02 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:27.006609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d3144-05dd-4c11-bc64-850947066a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:27.011249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d3144-05dd-4c11-bc64-850947066a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:27.011249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d3144-05dd-4c11-bc64-850947066a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:27.011249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d3144-05dd-4c11-bc64-850947066a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:27.011249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d3144-05dd-4c11-bc64-850947066a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:27.013838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d3144-05dd-4c11-bc64-850947066a7b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:27.031382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e01eb8305df451ca8d81c149b628bcc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:27.062211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e01eb8305df451ca8d81c149b628bcc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:27.063746 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e01eb8305df451ca8d81c149b628bcc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:27.072779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 953/1900] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:26 2022] DELETE /identity/v3/users/1e01eb8305df451ca8d81c149b628bcc => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:27.159566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 948/1901] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:26 2022] POST /identity/v3/projects => generated 399 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:27.163636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:27.170247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:27.266047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5e1ee-d6ee-4969-bf68-937c0aec4481 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:27.332469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2938-cc86-4773-af23-493ac74d7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:27.333228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2938-cc86-4773-af23-493ac74d7412 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:27.333511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2938-cc86-4773-af23-493ac74d7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:27.337138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2938-cc86-4773-af23-493ac74d7412 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:27.337845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e2938-cc86-4773-af23-493ac74d7412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:27.339867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e2938-cc86-4773-af23-493ac74d7412 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:27.431761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 954/1902] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:27 2022] POST /identity/v3/users => generated 306 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:27.436949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d3144-05dd-4c11-bc64-850947066a7b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:27.479347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d3144-05dd-4c11-bc64-850947066a7b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:27.491323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290757-c6e8-4f47-80cc-114bd662ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:27.492362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290757-c6e8-4f47-80cc-114bd662ab6c admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:27.492362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290757-c6e8-4f47-80cc-114bd662ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:27.492590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290757-c6e8-4f47-80cc-114bd662ab6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:27.496292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be290757-c6e8-4f47-80cc-114bd662ab6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:27.498857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be290757-c6e8-4f47-80cc-114bd662ab6c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:27.523323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 949/1903] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:27.527898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2938-cc86-4773-af23-493ac74d7412 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:27.541855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2938-cc86-4773-af23-493ac74d7412 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:27.557633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d048e-0347-4954-9271-b655ba824a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:27.558343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d048e-0347-4954-9271-b655ba824a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:27.558614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d048e-0347-4954-9271-b655ba824a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:27.559420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d048e-0347-4954-9271-b655ba824a68 admin admin] PATH_INFO: `/v3/projects/eb3cf64ae0af428d8ffc04974cb6a8c0/users/149ad68271864a1886d5e199b157ea34/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:27.589059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d048e-0347-4954-9271-b655ba824a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3cf64ae0af428d8ffc04974cb6a8c0, user_id=149ad68271864a1886d5e199b157ea34, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:27.594334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d048e-0347-4954-9271-b655ba824a68 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:27.710255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 955/1904] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:27 2022] PUT /identity/v3/projects/eb3cf64ae0af428d8ffc04974cb6a8c0/users/149ad68271864a1886d5e199b157ea34/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:27.711450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290757-c6e8-4f47-80cc-114bd662ab6c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:27.724522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290757-c6e8-4f47-80cc-114bd662ab6c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:27.825939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09197a6e-86a0-4b05-b19e-56ba9f44bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:27.826708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09197a6e-86a0-4b05-b19e-56ba9f44bc5c admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:27.827242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09197a6e-86a0-4b05-b19e-56ba9f44bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:27.827605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09197a6e-86a0-4b05-b19e-56ba9f44bc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:27.828418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09197a6e-86a0-4b05-b19e-56ba9f44bc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:27.830387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09197a6e-86a0-4b05-b19e-56ba9f44bc5c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:27.846596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 950/1905] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:27.884206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d048e-0347-4954-9271-b655ba824a68 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:27.926372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d048e-0347-4954-9271-b655ba824a68 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:27.933768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:27.935101 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:27.935380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:27.935658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] PATH_INFO: `/v3/projects/eb3cf64ae0af428d8ffc04974cb6a8c0/users/149ad68271864a1886d5e199b157ea34/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:27.938412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3cf64ae0af428d8ffc04974cb6a8c0, user_id=149ad68271864a1886d5e199b157ea34, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:27.941372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:27.954202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 956/1906] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:27 2022] PUT /identity/v3/projects/eb3cf64ae0af428d8ffc04974cb6a8c0/users/149ad68271864a1886d5e199b157ea34/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:27.967899 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc3195-c7f6-4f24-bbf8-1b7428ccd052 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:27.968631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc3195-c7f6-4f24-bbf8-1b7428ccd052 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:27.969421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc3195-c7f6-4f24-bbf8-1b7428ccd052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:28.015245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-70cc3195-c7f6-4f24-bbf8-1b7428ccd052 None None] MFA Rules not processed for user `149ad68271864a1886d5e199b157ea34`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:28.017325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-70cc3195-c7f6-4f24-bbf8-1b7428ccd052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:28.108521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 951/1907] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:28.121517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:28.124455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:28.270646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17707949-f8b8-42a9-beab-3436254294be admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:28.275844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:28.278456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc66d-924a-4c8a-b1fb-3eb10bef7312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:28.279321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc66d-924a-4c8a-b1fb-3eb10bef7312 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:28.279771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc66d-924a-4c8a-b1fb-3eb10bef7312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:28.280213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc66d-924a-4c8a-b1fb-3eb10bef7312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:28.293755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cc66d-924a-4c8a-b1fb-3eb10bef7312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:28.296424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cc66d-924a-4c8a-b1fb-3eb10bef7312 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:28.318227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 957/1908] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:28.319082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc3195-c7f6-4f24-bbf8-1b7428ccd052 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:28.321279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-70cc3195-c7f6-4f24-bbf8-1b7428ccd052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:28.443778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc3195-c7f6-4f24-bbf8-1b7428ccd052 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:28.473313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:28.473313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:28.473313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:28.473313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] PATH_INFO: `/v3/projects/0f1baf4bbece4f3aac8839ad55abf818` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:28.474090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1baf4bbece4f3aac8839ad55abf818)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:28.475716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:28.582963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc66d-924a-4c8a-b1fb-3eb10bef7312 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:28.597445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc66d-924a-4c8a-b1fb-3eb10bef7312 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:28.615872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1baf4bbece4f3aac8839ad55abf818', 'request_id': 'req-0503897d-7a05-402b-936b-57a03cbde9c8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:28.625524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1baf4bbece4f3aac8839ad55abf818', 'request_id': 'req-0503897d-7a05-402b-936b-57a03cbde9c8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:28.684673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1924-e64a-40c2-854c-b6f6714fe67f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:28.685858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1924-e64a-40c2-854c-b6f6714fe67f service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:28.686098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1924-e64a-40c2-854c-b6f6714fe67f service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:28.686383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1924-e64a-40c2-854c-b6f6714fe67f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:28.688403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3c2b1924-e64a-40c2-854c-b6f6714fe67f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:28.714154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1baf4bbece4f3aac8839ad55abf818', 'request_id': 'req-0503897d-7a05-402b-936b-57a03cbde9c8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:28.737660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] The token cache is being invalidate because project 0f1baf4bbece4f3aac8839ad55abf818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:28.737888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:28.738509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0503897d-7a05-402b-936b-57a03cbde9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:28.745283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 952/1909] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:28 2022] DELETE /identity/v3/projects/0f1baf4bbece4f3aac8839ad55abf818 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:28.747549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19d12c-57d4-4234-8aae-8ab25919f9c3 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:28.748754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19d12c-57d4-4234-8aae-8ab25919f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:28.749267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19d12c-57d4-4234-8aae-8ab25919f9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:28.775438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7b19d12c-57d4-4234-8aae-8ab25919f9c3 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:28.776968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7b19d12c-57d4-4234-8aae-8ab25919f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:28.790557 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b1924-e64a-40c2-854c-b6f6714fe67f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:28.798704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b1924-e64a-40c2-854c-b6f6714fe67f service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:28.818280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 958/1910] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:28.883695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 953/1911] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:28.894727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b522-397f-4b1d-8edd-a03490f495b6 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:28.895152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b522-397f-4b1d-8edd-a03490f495b6 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:28.895551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b522-397f-4b1d-8edd-a03490f495b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:28.944556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1a65b522-397f-4b1d-8edd-a03490f495b6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:28.945861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1a65b522-397f-4b1d-8edd-a03490f495b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:28.964564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 959/1912] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:28.971152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19d12c-57d4-4234-8aae-8ab25919f9c3 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:28.988920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19d12c-57d4-4234-8aae-8ab25919f9c3 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:29.000987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:29.001650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:29.004600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:29.005122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:29.005845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:29.006159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:29.008378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:29.025227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 954/1913] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:29.029898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65b522-397f-4b1d-8edd-a03490f495b6 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:29.042392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65b522-397f-4b1d-8edd-a03490f495b6 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:29.048955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54399a84-cee5-4f06-ad07-d78fb518aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:29.049693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399a84-cee5-4f06-ad07-d78fb518aa1a admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:29.050144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399a84-cee5-4f06-ad07-d78fb518aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:29.050539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399a84-cee5-4f06-ad07-d78fb518aa1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:29.051820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54399a84-cee5-4f06-ad07-d78fb518aa1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:29.053645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54399a84-cee5-4f06-ad07-d78fb518aa1a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:29.157557 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 960/1914] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:29 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:29.161769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:29.176066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fba1e-af8e-43dc-9cc6-18c9f441a682 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:29.251703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78149c3-e1cb-4276-add8-cdc253255bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:29.252359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78149c3-e1cb-4276-add8-cdc253255bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:29.252650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78149c3-e1cb-4276-add8-cdc253255bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:29.252950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78149c3-e1cb-4276-add8-cdc253255bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:29.253721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78149c3-e1cb-4276-add8-cdc253255bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:29.255721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78149c3-e1cb-4276-add8-cdc253255bf1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:29.367586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 955/1915] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:29 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:29.372536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54399a84-cee5-4f06-ad07-d78fb518aa1a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:29.383412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54399a84-cee5-4f06-ad07-d78fb518aa1a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:29.388925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dde94-6bba-437e-8bb6-d5c722ff0691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:29.389559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dde94-6bba-437e-8bb6-d5c722ff0691 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:29.389836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dde94-6bba-437e-8bb6-d5c722ff0691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:29.390634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dde94-6bba-437e-8bb6-d5c722ff0691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:29.391335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dde94-6bba-437e-8bb6-d5c722ff0691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:29.392957 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dde94-6bba-437e-8bb6-d5c722ff0691 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:29.405386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 961/1916] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:29.411324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78149c3-e1cb-4276-add8-cdc253255bf1 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:29.424737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78149c3-e1cb-4276-add8-cdc253255bf1 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:29.430498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee021f1e-65e4-4266-8900-812d138d8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:29.431310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021f1e-65e4-4266-8900-812d138d8273 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:29.431725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021f1e-65e4-4266-8900-812d138d8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:29.431953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021f1e-65e4-4266-8900-812d138d8273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:29.432654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee021f1e-65e4-4266-8900-812d138d8273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:29.436120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee021f1e-65e4-4266-8900-812d138d8273 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:29.450356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 956/1917] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:29.454774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dde94-6bba-437e-8bb6-d5c722ff0691 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:29.467765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dde94-6bba-437e-8bb6-d5c722ff0691 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:29.471704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213a2a6-6e43-4362-b3dd-b84748628081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:29.472410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213a2a6-6e43-4362-b3dd-b84748628081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:29.472683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213a2a6-6e43-4362-b3dd-b84748628081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:29.472997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213a2a6-6e43-4362-b3dd-b84748628081 admin admin] PATH_INFO: `/v3/projects/08e0a920aa304cafa6cbf72ef03e6eba/users/be9332831e284314883fa8f0ec0320d7/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:29.491407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213a2a6-6e43-4362-b3dd-b84748628081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e0a920aa304cafa6cbf72ef03e6eba, user_id=be9332831e284314883fa8f0ec0320d7, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:29.495216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213a2a6-6e43-4362-b3dd-b84748628081 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:29.627005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 962/1918] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:29 2022] PUT /identity/v3/projects/08e0a920aa304cafa6cbf72ef03e6eba/users/be9332831e284314883fa8f0ec0320d7/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:29.644392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1b15-eba4-465b-b600-168a1497b312 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:29.649218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1b15-eba4-465b-b600-168a1497b312 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:29.649218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1b15-eba4-465b-b600-168a1497b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:29.678744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4a9c1b15-eba4-465b-b600-168a1497b312 None None] MFA Rules not processed for user `be9332831e284314883fa8f0ec0320d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:29.680156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4a9c1b15-eba4-465b-b600-168a1497b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:29.751808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:29.763931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 957/1919] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:29.768260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213a2a6-6e43-4362-b3dd-b84748628081 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:29.894053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213a2a6-6e43-4362-b3dd-b84748628081 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:29.905417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60121bc-c08a-4886-a536-cc7219235a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:29.906324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60121bc-c08a-4886-a536-cc7219235a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:29.906723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60121bc-c08a-4886-a536-cc7219235a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:29.907086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60121bc-c08a-4886-a536-cc7219235a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:29.908058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60121bc-c08a-4886-a536-cc7219235a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:29.910653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60121bc-c08a-4886-a536-cc7219235a92 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:30.008718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 963/1920] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:29 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:30.010151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c1b15-eba4-465b-b600-168a1497b312 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:30.030114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c1b15-eba4-465b-b600-168a1497b312 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:30.105568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c96f8-6a58-4f92-b6cb-2d4a5cfba9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:30.106653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c96f8-6a58-4f92-b6cb-2d4a5cfba9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:30.107196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c96f8-6a58-4f92-b6cb-2d4a5cfba9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:30.107585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c96f8-6a58-4f92-b6cb-2d4a5cfba9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:30.108606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c96f8-6a58-4f92-b6cb-2d4a5cfba9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:30.112106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c96f8-6a58-4f92-b6cb-2d4a5cfba9c1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:30.195236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 958/1921] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:30 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:30.195450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60121bc-c08a-4886-a536-cc7219235a92 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:30.213456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60121bc-c08a-4886-a536-cc7219235a92 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:30.221822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50333401-177a-41ba-8f7d-8d8b5663ed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:30.222534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50333401-177a-41ba-8f7d-8d8b5663ed7e admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:30.222748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50333401-177a-41ba-8f7d-8d8b5663ed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:30.223021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50333401-177a-41ba-8f7d-8d8b5663ed7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:30.237649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50333401-177a-41ba-8f7d-8d8b5663ed7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:30.237649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50333401-177a-41ba-8f7d-8d8b5663ed7e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:30.239721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 964/1922] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:30.244113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c96f8-6a58-4f92-b6cb-2d4a5cfba9c1 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:30.257203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c96f8-6a58-4f92-b6cb-2d4a5cfba9c1 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:30.260272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065c185-8066-442d-ab2a-9c7511659547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:30.260927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065c185-8066-442d-ab2a-9c7511659547 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:30.261205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065c185-8066-442d-ab2a-9c7511659547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:30.261486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065c185-8066-442d-ab2a-9c7511659547 admin admin] PATH_INFO: `/v3/projects/c1b54915700a45f7bbb980c4919c2930/users/f8c7e8cd79eb446e97eaa0273cb86d5a/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:30.280493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065c185-8066-442d-ab2a-9c7511659547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b54915700a45f7bbb980c4919c2930, user_id=f8c7e8cd79eb446e97eaa0273cb86d5a, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:30.283593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065c185-8066-442d-ab2a-9c7511659547 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:30.361712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 959/1923] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:30 2022] PUT /identity/v3/projects/c1b54915700a45f7bbb980c4919c2930/users/f8c7e8cd79eb446e97eaa0273cb86d5a/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:30.365859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50333401-177a-41ba-8f7d-8d8b5663ed7e admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:30.377573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50333401-177a-41ba-8f7d-8d8b5663ed7e admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:30.462786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c190f77-8cce-49d4-8683-8df05a57b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:30.463922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190f77-8cce-49d4-8683-8df05a57b514 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:30.464340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190f77-8cce-49d4-8683-8df05a57b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:30.464767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190f77-8cce-49d4-8683-8df05a57b514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:30.466416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190f77-8cce-49d4-8683-8df05a57b514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:30.468920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190f77-8cce-49d4-8683-8df05a57b514 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:30.482928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 965/1924] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:30.493289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065c185-8066-442d-ab2a-9c7511659547 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:30.530058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065c185-8066-442d-ab2a-9c7511659547 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:30.530058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:30.530491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:30.530787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:30.531091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] PATH_INFO: `/v3/projects/c1b54915700a45f7bbb980c4919c2930/users/f8c7e8cd79eb446e97eaa0273cb86d5a/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:30.533504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b54915700a45f7bbb980c4919c2930, user_id=f8c7e8cd79eb446e97eaa0273cb86d5a, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:30.537378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:30.553189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 960/1925] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:30 2022] PUT /identity/v3/projects/c1b54915700a45f7bbb980c4919c2930/users/f8c7e8cd79eb446e97eaa0273cb86d5a/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:30.565181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0c728-9653-4529-9bda-910c83002b9d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:30.565571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0c728-9653-4529-9bda-910c83002b9d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:30.565997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0c728-9653-4529-9bda-910c83002b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:30.609299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-28f0c728-9653-4529-9bda-910c83002b9d None None] MFA Rules not processed for user `f8c7e8cd79eb446e97eaa0273cb86d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:30.610564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-28f0c728-9653-4529-9bda-910c83002b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:30.669690 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:30.706107 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 966/1926] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:30.718374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:30.720284 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:30.790627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d552b9-cdd5-4ba0-9558-0572620c94a7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:30.800937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e45507-9505-4983-a2ae-3128b20ca6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:30.801992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45507-9505-4983-a2ae-3128b20ca6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:30.802275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45507-9505-4983-a2ae-3128b20ca6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:30.803188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e45507-9505-4983-a2ae-3128b20ca6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:30.905405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e45507-9505-4983-a2ae-3128b20ca6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:30.906931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e45507-9505-4983-a2ae-3128b20ca6b1 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:30.909411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:30.918849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 961/1927] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:32.044568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:32.726709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:33.636422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:34.565633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:34.656640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0c728-9653-4529-9bda-910c83002b9d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:34.658222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-28f0c728-9653-4529-9bda-910c83002b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:34.728780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0c728-9653-4529-9bda-910c83002b9d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:34.733713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:34.734649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:34.734832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:34.735112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] PATH_INFO: `/v3/users/03d4eb3277d4462783babf09b61f4b97` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:34.736611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d4eb3277d4462783babf09b61f4b97)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:34.738592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:35.024936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d4eb3277d4462783babf09b61f4b97'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:35.045026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d4eb3277d4462783babf09b61f4b97'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:35.131302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d4eb3277d4462783babf09b61f4b97'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:35.148232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d4eb3277d4462783babf09b61f4b97'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:35.149254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d4eb3277d4462783babf09b61f4b97'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:35.157377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 967/1928] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:34 2022] DELETE /identity/v3/users/03d4eb3277d4462783babf09b61f4b97 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:35.162985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d561d8-3163-456b-976e-62218bb1a2f0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:35.163273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d561d8-3163-456b-976e-62218bb1a2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:35.163545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d561d8-3163-456b-976e-62218bb1a2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:35.184060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-80d561d8-3163-456b-976e-62218bb1a2f0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:35.185475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-80d561d8-3163-456b-976e-62218bb1a2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:35.247977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 962/1929] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:35.262236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:35.263904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:35.325404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48642d1-d819-4fa5-8117-8a9dbc6fbc50 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:35.332628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333503-340a-445c-a0b7-69bb6034fbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:35.333540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333503-340a-445c-a0b7-69bb6034fbaf service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:35.333931 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333503-340a-445c-a0b7-69bb6034fbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:35.334305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333503-340a-445c-a0b7-69bb6034fbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:35.346714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333503-340a-445c-a0b7-69bb6034fbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:35.348248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333503-340a-445c-a0b7-69bb6034fbaf service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:35.358612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 968/1930] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:35.734396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:35.827648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d561d8-3163-456b-976e-62218bb1a2f0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:35.830178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-80d561d8-3163-456b-976e-62218bb1a2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:35.861106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d561d8-3163-456b-976e-62218bb1a2f0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:35.865936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:35.866584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:35.867511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:35.867783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] PATH_INFO: `/v3/projects/107e80ddb7fc4d29aefc45d5f908a5e8` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:35.869061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107e80ddb7fc4d29aefc45d5f908a5e8)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:35.871003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:36.013513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107e80ddb7fc4d29aefc45d5f908a5e8', 'request_id': 'req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.020666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107e80ddb7fc4d29aefc45d5f908a5e8', 'request_id': 'req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.118495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107e80ddb7fc4d29aefc45d5f908a5e8', 'request_id': 'req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.144272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] The token cache is being invalidate because project 107e80ddb7fc4d29aefc45d5f908a5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:36.144984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.146072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.148578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 963/1931] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:35 2022] DELETE /identity/v3/projects/107e80ddb7fc4d29aefc45d5f908a5e8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:36.152745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333503-340a-445c-a0b7-69bb6034fbaf service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:36.163824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333503-340a-445c-a0b7-69bb6034fbaf service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:36.231185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:36.231972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:36.232327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:36.232614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] PATH_INFO: `/v3/users/149ad68271864a1886d5e199b157ea34` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:36.233888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149ad68271864a1886d5e199b157ea34)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:36.236345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:36.451952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149ad68271864a1886d5e199b157ea34'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.459195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149ad68271864a1886d5e199b157ea34'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.562037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149ad68271864a1886d5e199b157ea34'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.577965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149ad68271864a1886d5e199b157ea34'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.578824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149ad68271864a1886d5e199b157ea34'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:36.587497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 969/1932] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:36 2022] DELETE /identity/v3/users/149ad68271864a1886d5e199b157ea34 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:36.629933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:36.827770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:36.829351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:36.894519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2997-00b8-49c9-a7f0-ae0bbfdf0140 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:36.954742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c61499-501f-42de-b495-f0524d5111c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:36.956071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c61499-501f-42de-b495-f0524d5111c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:36.956462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c61499-501f-42de-b495-f0524d5111c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:36.956840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c61499-501f-42de-b495-f0524d5111c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:36.961990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-27c61499-501f-42de-b495-f0524d5111c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:37.041311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c61499-501f-42de-b495-f0524d5111c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:37.042778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c61499-501f-42de-b495-f0524d5111c7 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:37.053747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 964/1933] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:37.149284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:37.151769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:37.253324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48150a9e-07b7-44a0-84f6-7a5ecf9d2594 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:37.270289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:37.270963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:37.271246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:37.271523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] PATH_INFO: `/v3/projects/eb3cf64ae0af428d8ffc04974cb6a8c0` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:37.273021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3cf64ae0af428d8ffc04974cb6a8c0)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:37.274973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:37.401774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3cf64ae0af428d8ffc04974cb6a8c0', 'request_id': 'req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:37.407836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3cf64ae0af428d8ffc04974cb6a8c0', 'request_id': 'req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:37.504297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3cf64ae0af428d8ffc04974cb6a8c0', 'request_id': 'req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:37.519232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] The token cache is being invalidate because project eb3cf64ae0af428d8ffc04974cb6a8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:37.519580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:37.520224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f8cbef8-ab5d-4ab1-b248-e7b13638537f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:37.528027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 970/1934] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:37 2022] DELETE /identity/v3/projects/eb3cf64ae0af428d8ffc04974cb6a8c0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:37.528805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4055-8fdc-4a28-9f9d-3fd1d0501ecf None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:37.529130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4055-8fdc-4a28-9f9d-3fd1d0501ecf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:37.529401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde4055-8fdc-4a28-9f9d-3fd1d0501ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:37.551499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-efde4055-8fdc-4a28-9f9d-3fd1d0501ecf None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:37.552761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-efde4055-8fdc-4a28-9f9d-3fd1d0501ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:37.631889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 965/1935] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:37.640781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048098f-a020-4f90-8036-a30719fa0ff4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:37.641337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048098f-a020-4f90-8036-a30719fa0ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:37.641834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048098f-a020-4f90-8036-a30719fa0ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:37.667211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f048098f-a020-4f90-8036-a30719fa0ff4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:37.668651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f048098f-a020-4f90-8036-a30719fa0ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:37.678361 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 971/1936] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:37.682272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde4055-8fdc-4a28-9f9d-3fd1d0501ecf None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:37.692616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde4055-8fdc-4a28-9f9d-3fd1d0501ecf None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:37.697358 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:37.697783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:37.698059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:37.698326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:37.699006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:37.699882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:37.701942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:37.718208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 966/1937] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:37.719473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048098f-a020-4f90-8036-a30719fa0ff4 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:37.729046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048098f-a020-4f90-8036-a30719fa0ff4 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:37.735761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37731989-fc7e-4af0-bbbb-0cc021bd7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:37.736386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37731989-fc7e-4af0-bbbb-0cc021bd7d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:37.736672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37731989-fc7e-4af0-bbbb-0cc021bd7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:37.737124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37731989-fc7e-4af0-bbbb-0cc021bd7d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:37.737940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37731989-fc7e-4af0-bbbb-0cc021bd7d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:37.740383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37731989-fc7e-4af0-bbbb-0cc021bd7d47 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:37.906539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 972/1938] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:37 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:37.910303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:37.921374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb44795-ad9e-4eee-9756-ee800dcd90e7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:37.984197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c760b3b-d4af-432d-b779-02b439a2910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:37.984815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760b3b-d4af-432d-b779-02b439a2910d admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:37.985125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760b3b-d4af-432d-b779-02b439a2910d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:37.985451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760b3b-d4af-432d-b779-02b439a2910d admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:37.986124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c760b3b-d4af-432d-b779-02b439a2910d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:37.989022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c760b3b-d4af-432d-b779-02b439a2910d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:38.006016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:38.106183 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 967/1939] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:37 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:38.107602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37731989-fc7e-4af0-bbbb-0cc021bd7d47 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:38.118205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37731989-fc7e-4af0-bbbb-0cc021bd7d47 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:38.123698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08537b51-70ab-49e4-985a-f1ed2bb6411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:38.124385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08537b51-70ab-49e4-985a-f1ed2bb6411b admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:38.124671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08537b51-70ab-49e4-985a-f1ed2bb6411b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:38.124981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08537b51-70ab-49e4-985a-f1ed2bb6411b admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:38.129726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08537b51-70ab-49e4-985a-f1ed2bb6411b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:38.129726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08537b51-70ab-49e4-985a-f1ed2bb6411b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:38.139520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 973/1940] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:38.143784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c760b3b-d4af-432d-b779-02b439a2910d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:38.154776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c760b3b-d4af-432d-b779-02b439a2910d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:38.161813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9180a-51a8-449f-85db-3b44b5654275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:38.161813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9180a-51a8-449f-85db-3b44b5654275 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:38.161813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9180a-51a8-449f-85db-3b44b5654275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:38.161813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9180a-51a8-449f-85db-3b44b5654275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:38.162157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9180a-51a8-449f-85db-3b44b5654275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:38.162992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9180a-51a8-449f-85db-3b44b5654275 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:38.173670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 968/1941] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:25:38.178069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08537b51-70ab-49e4-985a-f1ed2bb6411b admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:38.189407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08537b51-70ab-49e4-985a-f1ed2bb6411b admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:38.194200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0468d-d859-4dce-8abb-aa4f007dbb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:38.194939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0468d-d859-4dce-8abb-aa4f007dbb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:38.195292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0468d-d859-4dce-8abb-aa4f007dbb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:38.195637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0468d-d859-4dce-8abb-aa4f007dbb03 admin admin] PATH_INFO: `/v3/projects/4b53fe1e9070437c8e8af85be003e57c/users/84bea16f9bd047259738650d91a14015/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:38.211561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0468d-d859-4dce-8abb-aa4f007dbb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b53fe1e9070437c8e8af85be003e57c, user_id=84bea16f9bd047259738650d91a14015, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:38.214363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0468d-d859-4dce-8abb-aa4f007dbb03 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:38.288419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 974/1942] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:38 2022] PUT /identity/v3/projects/4b53fe1e9070437c8e8af85be003e57c/users/84bea16f9bd047259738650d91a14015/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:38.301170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c75b-47fa-4bc1-af1c-e9fa6cf7511e None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:38.301466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c75b-47fa-4bc1-af1c-e9fa6cf7511e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:38.301801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c75b-47fa-4bc1-af1c-e9fa6cf7511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:38.338864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-8061c75b-47fa-4bc1-af1c-e9fa6cf7511e None None] MFA Rules not processed for user `84bea16f9bd047259738650d91a14015`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:38.342314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8061c75b-47fa-4bc1-af1c-e9fa6cf7511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:38.412146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 969/1943] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:38.416407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0468d-d859-4dce-8abb-aa4f007dbb03 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:38.489700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0468d-d859-4dce-8abb-aa4f007dbb03 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:38.494930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d171f-2bb6-487b-be94-9bdc50ad23e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:38.495558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d171f-2bb6-487b-be94-9bdc50ad23e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:38.495844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d171f-2bb6-487b-be94-9bdc50ad23e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:38.496120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d171f-2bb6-487b-be94-9bdc50ad23e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:38.502912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d171f-2bb6-487b-be94-9bdc50ad23e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:38.502912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d171f-2bb6-487b-be94-9bdc50ad23e1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:38.610299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 975/1944] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:38 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:38.614458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c75b-47fa-4bc1-af1c-e9fa6cf7511e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:38.626028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c75b-47fa-4bc1-af1c-e9fa6cf7511e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:38.686800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099b92-a188-449f-b4d0-d6a47f4305df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:38.687363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099b92-a188-449f-b4d0-d6a47f4305df admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:38.687641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099b92-a188-449f-b4d0-d6a47f4305df admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:38.687914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099b92-a188-449f-b4d0-d6a47f4305df admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:38.688619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e099b92-a188-449f-b4d0-d6a47f4305df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:38.690566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e099b92-a188-449f-b4d0-d6a47f4305df admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:38.838714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 970/1945] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:38 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:38.840780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d171f-2bb6-487b-be94-9bdc50ad23e1 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:38.851467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d171f-2bb6-487b-be94-9bdc50ad23e1 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:38.856952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19da7a6-9ae6-42a0-b952-e7008c43f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:38.857531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19da7a6-9ae6-42a0-b952-e7008c43f7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:38.857807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19da7a6-9ae6-42a0-b952-e7008c43f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:38.858075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19da7a6-9ae6-42a0-b952-e7008c43f7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:38.858774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19da7a6-9ae6-42a0-b952-e7008c43f7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:38.860375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19da7a6-9ae6-42a0-b952-e7008c43f7d2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:38.875283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 976/1946] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:38.876514 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099b92-a188-449f-b4d0-d6a47f4305df admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:38.887111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099b92-a188-449f-b4d0-d6a47f4305df admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:38.891809 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ee654-c21c-40bc-adef-382112d8feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:38.892537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ee654-c21c-40bc-adef-382112d8feff admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:38.892811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ee654-c21c-40bc-adef-382112d8feff admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:38.893111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ee654-c21c-40bc-adef-382112d8feff admin admin] PATH_INFO: `/v3/projects/03a39a730f834e0697c8b11ca1d8798d/users/757fb04ecfc24c15a6210cc9d14f8e2c/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:38.911504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ee654-c21c-40bc-adef-382112d8feff admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a39a730f834e0697c8b11ca1d8798d, user_id=757fb04ecfc24c15a6210cc9d14f8e2c, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:38.914257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ee654-c21c-40bc-adef-382112d8feff admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:38.984089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:38.991142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 971/1947] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:38 2022] PUT /identity/v3/projects/03a39a730f834e0697c8b11ca1d8798d/users/757fb04ecfc24c15a6210cc9d14f8e2c/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:38.997573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19da7a6-9ae6-42a0-b952-e7008c43f7d2 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:39.008524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19da7a6-9ae6-42a0-b952-e7008c43f7d2 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:39.073967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dc43e-0acb-4074-8cbb-51c5fa7a3274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:39.074457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc43e-0acb-4074-8cbb-51c5fa7a3274 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:39.075589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc43e-0acb-4074-8cbb-51c5fa7a3274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:39.075964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc43e-0acb-4074-8cbb-51c5fa7a3274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:39.076870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dc43e-0acb-4074-8cbb-51c5fa7a3274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:39.078552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dc43e-0acb-4074-8cbb-51c5fa7a3274 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:39.089185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 977/1948] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:25:39.094007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ee654-c21c-40bc-adef-382112d8feff admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:39.108198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ee654-c21c-40bc-adef-382112d8feff admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:39.113240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:39.114143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:39.114413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:39.114687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] PATH_INFO: `/v3/projects/03a39a730f834e0697c8b11ca1d8798d/users/757fb04ecfc24c15a6210cc9d14f8e2c/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:39.117273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a39a730f834e0697c8b11ca1d8798d, user_id=757fb04ecfc24c15a6210cc9d14f8e2c, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:39.120023 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:39.134860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 972/1949] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:39 2022] PUT /identity/v3/projects/03a39a730f834e0697c8b11ca1d8798d/users/757fb04ecfc24c15a6210cc9d14f8e2c/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:39.145554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f45980-7207-4a45-956c-025a3c375cf7 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:39.145841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f45980-7207-4a45-956c-025a3c375cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:39.146293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f45980-7207-4a45-956c-025a3c375cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:39.179511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-42f45980-7207-4a45-956c-025a3c375cf7 None None] MFA Rules not processed for user `757fb04ecfc24c15a6210cc9d14f8e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:39.180769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-42f45980-7207-4a45-956c-025a3c375cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:39.257481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 978/1950] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:39.269429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:39.271213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:39.333508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dae3cb-9252-4f76-9144-9d287d9275df admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:39.338061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f80f14-0660-41db-b197-74eba08f68b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:39.338948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80f14-0660-41db-b197-74eba08f68b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:39.339263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80f14-0660-41db-b197-74eba08f68b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:39.339545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80f14-0660-41db-b197-74eba08f68b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:39.356930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f80f14-0660-41db-b197-74eba08f68b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:39.358599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f80f14-0660-41db-b197-74eba08f68b0 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:39.370359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 973/1951] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:40.222808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:40.885345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f45980-7207-4a45-956c-025a3c375cf7 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:40.954039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f45980-7207-4a45-956c-025a3c375cf7 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:40.961941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:40.963451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:40.963451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:40.963647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] PATH_INFO: `/v3/users/84bea16f9bd047259738650d91a14015` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:40.965266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84bea16f9bd047259738650d91a14015)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:40.967794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:41.104695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:41.180729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84bea16f9bd047259738650d91a14015'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:41.200370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84bea16f9bd047259738650d91a14015'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:41.304779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84bea16f9bd047259738650d91a14015'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:41.321078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84bea16f9bd047259738650d91a14015'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:41.321944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84bea16f9bd047259738650d91a14015'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:41.330709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 979/1952] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:40 2022] DELETE /identity/v3/users/84bea16f9bd047259738650d91a14015 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:41.335419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6621e6-14aa-4d50-88aa-251db4f720cb None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:41.335710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6621e6-14aa-4d50-88aa-251db4f720cb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:41.336344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6621e6-14aa-4d50-88aa-251db4f720cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:41.372792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2f6621e6-14aa-4d50-88aa-251db4f720cb None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:41.374556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2f6621e6-14aa-4d50-88aa-251db4f720cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:41.443833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 974/1953] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:41.454620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:41.456206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:41.534054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84996639-ba4f-4722-bac8-fa1a5bb2c949 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:41.537936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473939e9-1aea-4207-9abd-bd6c287e3508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:41.538666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473939e9-1aea-4207-9abd-bd6c287e3508 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:41.539119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473939e9-1aea-4207-9abd-bd6c287e3508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:41.539514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473939e9-1aea-4207-9abd-bd6c287e3508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:41.551017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473939e9-1aea-4207-9abd-bd6c287e3508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:41.552681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473939e9-1aea-4207-9abd-bd6c287e3508 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:41.564944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 980/1954] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:42.220942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6621e6-14aa-4d50-88aa-251db4f720cb None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:42.223157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2f6621e6-14aa-4d50-88aa-251db4f720cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:42.253025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6621e6-14aa-4d50-88aa-251db4f720cb None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:42.269380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:42.270064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:42.271753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:42.272456 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] PATH_INFO: `/v3/projects/4b53fe1e9070437c8e8af85be003e57c` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:42.273937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b53fe1e9070437c8e8af85be003e57c)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:42.276206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:42.480130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b53fe1e9070437c8e8af85be003e57c', 'request_id': 'req-02db518f-e4d8-4586-9737-307720be74fd'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:42.484181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b53fe1e9070437c8e8af85be003e57c', 'request_id': 'req-02db518f-e4d8-4586-9737-307720be74fd'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:42.687232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b53fe1e9070437c8e8af85be003e57c', 'request_id': 'req-02db518f-e4d8-4586-9737-307720be74fd'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:42.700510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] The token cache is being invalidate because project 4b53fe1e9070437c8e8af85be003e57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:42.700828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:42.701561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:42.703552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 975/1955] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:42 2022] DELETE /identity/v3/projects/4b53fe1e9070437c8e8af85be003e57c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:42.707374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473939e9-1aea-4207-9abd-bd6c287e3508 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:42.718444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473939e9-1aea-4207-9abd-bd6c287e3508 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:42.778011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:42.778830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:42.779149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:42.779397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] PATH_INFO: `/v3/users/757fb04ecfc24c15a6210cc9d14f8e2c` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:42.780613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757fb04ecfc24c15a6210cc9d14f8e2c)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:42.782864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:42.922297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:42.993348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:43.006853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757fb04ecfc24c15a6210cc9d14f8e2c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.018110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757fb04ecfc24c15a6210cc9d14f8e2c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.115789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757fb04ecfc24c15a6210cc9d14f8e2c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.129714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757fb04ecfc24c15a6210cc9d14f8e2c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.130522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757fb04ecfc24c15a6210cc9d14f8e2c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.136667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 981/1956] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:42 2022] DELETE /identity/v3/users/757fb04ecfc24c15a6210cc9d14f8e2c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:43.485476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:43.486755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:43.522479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db518f-e4d8-4586-9737-307720be74fd admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:43.585529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:43.586335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:43.586614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:43.586887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] PATH_INFO: `/v3/users/be9332831e284314883fa8f0ec0320d7` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:43.588134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9332831e284314883fa8f0ec0320d7)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:43.590864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:43.695069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:43.697272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:43.719539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dde81-4267-431e-9797-a1ed2dcc78e7 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:43.742698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:43.743395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:43.744200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:43.744200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] PATH_INFO: `/v3/projects/03a39a730f834e0697c8b11ca1d8798d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:43.745268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a39a730f834e0697c8b11ca1d8798d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:43.752667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:43.879853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9332831e284314883fa8f0ec0320d7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.880544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9332831e284314883fa8f0ec0320d7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.881770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9332831e284314883fa8f0ec0320d7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.896194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9332831e284314883fa8f0ec0320d7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.955609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a39a730f834e0697c8b11ca1d8798d', 'request_id': 'req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:43.962832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a39a730f834e0697c8b11ca1d8798d', 'request_id': 'req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:44.001370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-137b4d15-5d6a-4214-b29b-1e47f01838a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9332831e284314883fa8f0ec0320d7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:44.017151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 976/1957] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:43 2022] DELETE /identity/v3/users/be9332831e284314883fa8f0ec0320d7 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:44.021756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2706be-5203-4250-9d2d-5b0be0e47c9e None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.022410 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2706be-5203-4250-9d2d-5b0be0e47c9e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.022829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2706be-5203-4250-9d2d-5b0be0e47c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.044678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4b2706be-5203-4250-9d2d-5b0be0e47c9e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:44.046077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4b2706be-5203-4250-9d2d-5b0be0e47c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.098299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a39a730f834e0697c8b11ca1d8798d', 'request_id': 'req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:44.108453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 977/1958] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:44.115700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] The token cache is being invalidate because project 03a39a730f834e0697c8b11ca1d8798d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:44.115700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:44.115700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8d1b9e5-193c-4f0c-9a08-c32ce3d0124a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:44.121027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 982/1959] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:43 2022] DELETE /identity/v3/projects/03a39a730f834e0697c8b11ca1d8798d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:44.121265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2706be-5203-4250-9d2d-5b0be0e47c9e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.121265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4b2706be-5203-4250-9d2d-5b0be0e47c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.122929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2b61-781b-4583-b9d7-37758a6bafe2 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.123221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2b61-781b-4583-b9d7-37758a6bafe2 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.123503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2b61-781b-4583-b9d7-37758a6bafe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.145092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b68c2b61-781b-4583-b9d7-37758a6bafe2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:44.150534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b68c2b61-781b-4583-b9d7-37758a6bafe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.158248 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 983/1960] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:44.166108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2869-f0c5-4dd7-86f9-f27650116698 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.166468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2869-f0c5-4dd7-86f9-f27650116698 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.166855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2869-f0c5-4dd7-86f9-f27650116698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.198013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-155c2869-f0c5-4dd7-86f9-f27650116698 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:44.199821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-155c2869-f0c5-4dd7-86f9-f27650116698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.220135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 984/1961] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:44.222080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2706be-5203-4250-9d2d-5b0be0e47c9e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.224139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2869-f0c5-4dd7-86f9-f27650116698 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.227272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.227908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.228372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.228696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.233471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.235249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2869-f0c5-4dd7-86f9-f27650116698 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.242203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.243213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.243841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.244140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.244837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:44.245178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.246775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.247033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.248618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.259203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 978/1962] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:44.263448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 985/1963] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:44.267704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.280080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5ee2b-ea84-4342-a6eb-9b9da41a5c84 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.285064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd166a5-8260-4558-8dd1-0f51c35fef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.285680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd166a5-8260-4558-8dd1-0f51c35fef82 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.288471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd166a5-8260-4558-8dd1-0f51c35fef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.288471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd166a5-8260-4558-8dd1-0f51c35fef82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.288471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd166a5-8260-4558-8dd1-0f51c35fef82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.288925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd166a5-8260-4558-8dd1-0f51c35fef82 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.411063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 979/1964] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:44 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:44.411928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.423822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa39a09-1c47-49c6-98cb-ff06536f0ce4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.497044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9900d0-9c57-45bb-85df-3ad39331c465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.498130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9900d0-9c57-45bb-85df-3ad39331c465 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.498401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9900d0-9c57-45bb-85df-3ad39331c465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.498676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9900d0-9c57-45bb-85df-3ad39331c465 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.499648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9900d0-9c57-45bb-85df-3ad39331c465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.501609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9900d0-9c57-45bb-85df-3ad39331c465 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.636234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 986/1965] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:44 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:44.636537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99ce6-b5bb-4d87-b9ed-3aed88c88392 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.637445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99ce6-b5bb-4d87-b9ed-3aed88c88392 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.637721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99ce6-b5bb-4d87-b9ed-3aed88c88392 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.639151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 980/1966] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:25:44.640504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9900d0-9c57-45bb-85df-3ad39331c465 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.644076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b09e49-5d85-49ec-991d-eef48d3f6fc3 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.644417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b09e49-5d85-49ec-991d-eef48d3f6fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.644746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b09e49-5d85-49ec-991d-eef48d3f6fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.651983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9900d0-9c57-45bb-85df-3ad39331c465 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.657730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512653-96c6-4fcf-a9d4-c269d3b7d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.660968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512653-96c6-4fcf-a9d4-c269d3b7d4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.660968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512653-96c6-4fcf-a9d4-c269d3b7d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.660968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512653-96c6-4fcf-a9d4-c269d3b7d4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.660968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26512653-96c6-4fcf-a9d4-c269d3b7d4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.662288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26512653-96c6-4fcf-a9d4-c269d3b7d4bc admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.667723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-89b09e49-5d85-49ec-991d-eef48d3f6fc3 None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:44.669880 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-89b09e49-5d85-49ec-991d-eef48d3f6fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.678992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 987/1967] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:44.679893 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512653-96c6-4fcf-a9d4-c269d3b7d4bc admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.691260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512653-96c6-4fcf-a9d4-c269d3b7d4bc admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.696653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207af0d-2364-4ab0-8a09-ec7a102da82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.701773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207af0d-2364-4ab0-8a09-ec7a102da82b admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.701773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207af0d-2364-4ab0-8a09-ec7a102da82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.701773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207af0d-2364-4ab0-8a09-ec7a102da82b admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.701773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207af0d-2364-4ab0-8a09-ec7a102da82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.701773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207af0d-2364-4ab0-8a09-ec7a102da82b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.714371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 988/1968] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:44.721650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207af0d-2364-4ab0-8a09-ec7a102da82b admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.740913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207af0d-2364-4ab0-8a09-ec7a102da82b admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.747626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4cda-94c9-4773-8dc2-700ce4236afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.748555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4cda-94c9-4773-8dc2-700ce4236afc admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.748845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4cda-94c9-4773-8dc2-700ce4236afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.749325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4cda-94c9-4773-8dc2-700ce4236afc admin admin] PATH_INFO: `/v3/projects/6be7930027004be189d399cdc3cc9d33/users/f3aab051a9174adbb9f22b84414e0b46/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.754839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 981/1969] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:44.767091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b09e49-5d85-49ec-991d-eef48d3f6fc3 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.767395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c4cda-94c9-4773-8dc2-700ce4236afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be7930027004be189d399cdc3cc9d33, user_id=f3aab051a9174adbb9f22b84414e0b46, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.769928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-89b09e49-5d85-49ec-991d-eef48d3f6fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.770265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c4cda-94c9-4773-8dc2-700ce4236afc admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.783814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b09e49-5d85-49ec-991d-eef48d3f6fc3 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.789368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.792999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.792999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.792999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.800442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.802156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.814191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 982/1970] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:44.829200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.831132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.843752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 989/1971] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:44 2022] PUT /identity/v3/projects/6be7930027004be189d399cdc3cc9d33/users/f3aab051a9174adbb9f22b84414e0b46/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:44.849258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988daf-a209-4825-89ec-3a01f0c78bf5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.849633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988daf-a209-4825-89ec-3a01f0c78bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.850053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988daf-a209-4825-89ec-3a01f0c78bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.860556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37beacf-0f78-4f4f-9109-4b7d31ccda00 service placement] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:44.880407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b1988daf-a209-4825-89ec-3a01f0c78bf5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:44.881688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b1988daf-a209-4825-89ec-3a01f0c78bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.956247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:44.957148 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:44.957594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:44.958036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] PATH_INFO: `/v3/users/08c83e5f57c341918a74006d47a4249d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:44.959543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c83e5f57c341918a74006d47a4249d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:44.962090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:44.963328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 990/1972] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:44.985327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988daf-a209-4825-89ec-3a01f0c78bf5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:44.986778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b1988daf-a209-4825-89ec-3a01f0c78bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:44.995808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:45.058284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988daf-a209-4825-89ec-3a01f0c78bf5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:45.063249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:45.063888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:45.064238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:45.064517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:45.070332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:45.078903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:45.080383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:45.097399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 991/1973] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:45.178991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:45.180423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:45.243543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c83e5f57c341918a74006d47a4249d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.244547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c83e5f57c341918a74006d47a4249d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.245827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c83e5f57c341918a74006d47a4249d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.258880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc49cf4-75d2-4b72-9c6b-59329710b64f service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:45.264647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:45.265332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:45.265615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:45.266069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:45.267919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:45.275287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c83e5f57c341918a74006d47a4249d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.337582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:45.339035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:45.349852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 992/1974] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:45.350741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:45.352038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:45.357088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c83e5f57c341918a74006d47a4249d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.368201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3043f5-6f02-46a1-a870-adee8b778da8 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:45.371139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 983/1975] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:44 2022] DELETE /identity/v3/users/08c83e5f57c341918a74006d47a4249d => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:45.374190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:45.374853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:45.375135 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:45.375417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] PATH_INFO: `/v3/projects/08e0a920aa304cafa6cbf72ef03e6eba` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:45.376776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e0a920aa304cafa6cbf72ef03e6eba)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:45.378971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:45.542271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e0a920aa304cafa6cbf72ef03e6eba', 'request_id': 'req-dc236da0-0cf4-4375-8812-f13845b2f6e4'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.550856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e0a920aa304cafa6cbf72ef03e6eba', 'request_id': 'req-dc236da0-0cf4-4375-8812-f13845b2f6e4'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.743156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e0a920aa304cafa6cbf72ef03e6eba', 'request_id': 'req-dc236da0-0cf4-4375-8812-f13845b2f6e4'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.755644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] The token cache is being invalidate because project 08e0a920aa304cafa6cbf72ef03e6eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:45.762521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.762521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:45.762521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 993/1976] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:45 2022] DELETE /identity/v3/projects/08e0a920aa304cafa6cbf72ef03e6eba => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:45.762942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:45.806159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:45.808170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:45.863984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429e29b-9469-430c-b58b-35d852236688 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:45.889979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc236da0-0cf4-4375-8812-f13845b2f6e4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:45.895752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:45.901136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:45.901954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:45.903853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] PATH_INFO: `/v3/projects/167700163b7c48bea6b6d0da9b61d39f` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:45.905467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167700163b7c48bea6b6d0da9b61d39f)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:45.907962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:45.927257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:45.930242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:45.930242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:45.930242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] PATH_INFO: `/v3/users/f8c7e8cd79eb446e97eaa0273cb86d5a` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:45.930242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c7e8cd79eb446e97eaa0273cb86d5a)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:45.931819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:46.038352 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167700163b7c48bea6b6d0da9b61d39f', 'request_id': 'req-4fcf2394-897c-4904-a1fc-8491479c58d2'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.047242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167700163b7c48bea6b6d0da9b61d39f', 'request_id': 'req-4fcf2394-897c-4904-a1fc-8491479c58d2'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.157551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167700163b7c48bea6b6d0da9b61d39f', 'request_id': 'req-4fcf2394-897c-4904-a1fc-8491479c58d2'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.162893 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c7e8cd79eb446e97eaa0273cb86d5a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.163716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c7e8cd79eb446e97eaa0273cb86d5a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.164346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c7e8cd79eb446e97eaa0273cb86d5a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.179218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c7e8cd79eb446e97eaa0273cb86d5a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.186357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] The token cache is being invalidate because project 167700163b7c48bea6b6d0da9b61d39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:46.186687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.187386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4fcf2394-897c-4904-a1fc-8491479c58d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.189109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 994/1977] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:45 2022] DELETE /identity/v3/projects/167700163b7c48bea6b6d0da9b61d39f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:46.193781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f8db0-4996-4cb4-ba84-9f28cd0ffa43 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.194179 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f8db0-4996-4cb4-ba84-9f28cd0ffa43 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.194807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f8db0-4996-4cb4-ba84-9f28cd0ffa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.216480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-433f8db0-4996-4cb4-ba84-9f28cd0ffa43 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:46.217401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-433f8db0-4996-4cb4-ba84-9f28cd0ffa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:46.258630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1abf373f-9443-4dde-9aa0-4a9bd7ddacf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c7e8cd79eb446e97eaa0273cb86d5a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:46.274726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 984/1978] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:45 2022] DELETE /identity/v3/users/f8c7e8cd79eb446e97eaa0273cb86d5a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:46.304929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 995/1979] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:46.305641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:46.310715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac1a6-469e-4dc3-b03b-8d262ddfd7e8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.315525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac1a6-469e-4dc3-b03b-8d262ddfd7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.315525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac1a6-469e-4dc3-b03b-8d262ddfd7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.335658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-bd3ac1a6-469e-4dc3-b03b-8d262ddfd7e8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:46.337071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bd3ac1a6-469e-4dc3-b03b-8d262ddfd7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:46.415371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 985/1980] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:46.420620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f8db0-4996-4cb4-ba84-9f28cd0ffa43 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:46.430726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f8db0-4996-4cb4-ba84-9f28cd0ffa43 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:46.436192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:46.436815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.437128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.437405 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.438106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:46.438411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:46.440217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:46.455202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 996/1981] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:25:46.459695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ac1a6-469e-4dc3-b03b-8d262ddfd7e8 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:46.470281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ac1a6-469e-4dc3-b03b-8d262ddfd7e8 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:46.474898 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417a1a-ce19-4e4a-894d-870b220e1207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:46.475524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417a1a-ce19-4e4a-894d-870b220e1207 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.475798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417a1a-ce19-4e4a-894d-870b220e1207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.478716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417a1a-ce19-4e4a-894d-870b220e1207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.478716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e417a1a-ce19-4e4a-894d-870b220e1207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:46.478716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e417a1a-ce19-4e4a-894d-870b220e1207 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:46.582559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:46.583087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 986/1982] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:46 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:46.600629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1996e-d70e-43b5-959f-b5525ec4a0ac admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:46.675120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66dd02-1c99-4f08-9305-fb6139e43692 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.675437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66dd02-1c99-4f08-9305-fb6139e43692 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.675713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66dd02-1c99-4f08-9305-fb6139e43692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.689810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88dfad-348f-4345-9387-dfc4619e507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:46.690960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88dfad-348f-4345-9387-dfc4619e507c admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.691479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88dfad-348f-4345-9387-dfc4619e507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.692004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88dfad-348f-4345-9387-dfc4619e507c admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.693071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88dfad-348f-4345-9387-dfc4619e507c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:46.698350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88dfad-348f-4345-9387-dfc4619e507c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:46.718740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cb66dd02-1c99-4f08-9305-fb6139e43692 None None] MFA Rules not processed for user `f3aab051a9174adbb9f22b84414e0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:46.720113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cb66dd02-1c99-4f08-9305-fb6139e43692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:46.807461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 987/1983] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:46.816759 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66dd02-1c99-4f08-9305-fb6139e43692 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:46.818717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cb66dd02-1c99-4f08-9305-fb6139e43692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:46.826444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 997/1984] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:46 2022] POST /identity/v3/users => generated 302 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:46.833645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88dfad-348f-4345-9387-dfc4619e507c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:46.846291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88dfad-348f-4345-9387-dfc4619e507c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:46.853689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c6385-37eb-4b42-ba11-8a253657aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:46.854337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c6385-37eb-4b42-ba11-8a253657aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.857175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c6385-37eb-4b42-ba11-8a253657aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.857693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c6385-37eb-4b42-ba11-8a253657aad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.858762 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c6385-37eb-4b42-ba11-8a253657aad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:46.860519 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c6385-37eb-4b42-ba11-8a253657aad8 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:46.875069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 998/1985] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:46.879532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c6385-37eb-4b42-ba11-8a253657aad8 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:46.890849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c6385-37eb-4b42-ba11-8a253657aad8 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:46.896076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66dd02-1c99-4f08-9305-fb6139e43692 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:46.896650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:46.897570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.897852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.898126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.898862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:46.900419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:46.905160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dec6bd-aca9-4e7a-9656-da01e38f40c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:46.906777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dec6bd-aca9-4e7a-9656-da01e38f40c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.907710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dec6bd-aca9-4e7a-9656-da01e38f40c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.908398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dec6bd-aca9-4e7a-9656-da01e38f40c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.911846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 999/1986] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:25:46.914225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:46.916303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:46.920974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dec6bd-aca9-4e7a-9656-da01e38f40c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:46.922613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dec6bd-aca9-4e7a-9656-da01e38f40c3 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:46.937504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cede4-c749-4091-999b-9fb62ceeeb72 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:46.938462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 988/1987] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:46.940059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dec6bd-aca9-4e7a-9656-da01e38f40c3 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:46.949359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:46.950020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.950305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.951568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] PATH_INFO: `/v3/projects/c1b54915700a45f7bbb980c4919c2930` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.952183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b54915700a45f7bbb980c4919c2930)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:46.954403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dec6bd-aca9-4e7a-9656-da01e38f40c3 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:46.954842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:46.959703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611038b-118c-46e4-b63c-2eb07bbc41b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:46.960471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611038b-118c-46e4-b63c-2eb07bbc41b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:46.960815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611038b-118c-46e4-b63c-2eb07bbc41b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:46.961221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611038b-118c-46e4-b63c-2eb07bbc41b5 admin admin] PATH_INFO: `/v3/projects/a0083939278247b0b8a43512d3e8e694/users/948a1e2233354b69ad6a4b42dbf2d9cc/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:46.983368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611038b-118c-46e4-b63c-2eb07bbc41b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0083939278247b0b8a43512d3e8e694, user_id=948a1e2233354b69ad6a4b42dbf2d9cc, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:46.986465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611038b-118c-46e4-b63c-2eb07bbc41b5 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:47.100720 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 989/1988] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:46 2022] PUT /identity/v3/projects/a0083939278247b0b8a43512d3e8e694/users/948a1e2233354b69ad6a4b42dbf2d9cc/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:47.107862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e3c3-a11b-4602-988d-95474ec63e33 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.108209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e3c3-a11b-4602-988d-95474ec63e33 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.108427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e3c3-a11b-4602-988d-95474ec63e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.111098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b54915700a45f7bbb980c4919c2930', 'request_id': 'req-25b345c5-123e-462e-b185-532ac4a3a7bc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:47.118346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b54915700a45f7bbb980c4919c2930', 'request_id': 'req-25b345c5-123e-462e-b185-532ac4a3a7bc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:47.133853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-44d4e3c3-a11b-4602-988d-95474ec63e33 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:47.135080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-44d4e3c3-a11b-4602-988d-95474ec63e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:47.177324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:47.205390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b54915700a45f7bbb980c4919c2930', 'request_id': 'req-25b345c5-123e-462e-b185-532ac4a3a7bc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:47.211080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 990/1989] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:47.222180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4e3c3-a11b-4602-988d-95474ec63e33 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:47.223599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-44d4e3c3-a11b-4602-988d-95474ec63e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:47.224613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] The token cache is being invalidate because project c1b54915700a45f7bbb980c4919c2930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:47.225006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:47.226216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-25b345c5-123e-462e-b185-532ac4a3a7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:47.228281 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1000/1990] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:46 2022] DELETE /identity/v3/projects/c1b54915700a45f7bbb980c4919c2930 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:47.234995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268ec55-0f67-4e57-80b2-084601d71087 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.235410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268ec55-0f67-4e57-80b2-084601d71087 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.235765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268ec55-0f67-4e57-80b2-084601d71087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.259655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-3268ec55-0f67-4e57-80b2-084601d71087 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:47.267343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3268ec55-0f67-4e57-80b2-084601d71087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:47.270860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1001/1991] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:47.280821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83b9d-ace3-4d81-aa4e-9ae37f727d15 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.281144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83b9d-ace3-4d81-aa4e-9ae37f727d15 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.281428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83b9d-ace3-4d81-aa4e-9ae37f727d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.296776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4e3c3-a11b-4602-988d-95474ec63e33 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:47.301131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:47.301793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.302075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.302374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.304334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:47.304501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-03d83b9d-ace3-4d81-aa4e-9ae37f727d15 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:47.305784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-03d83b9d-ace3-4d81-aa4e-9ae37f727d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:47.318690 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:47.320151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:47.325185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1002/1992] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:47.329989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d83b9d-ace3-4d81-aa4e-9ae37f727d15 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:47.340779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d83b9d-ace3-4d81-aa4e-9ae37f727d15 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:47.341939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 991/1993] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:47.347625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:47.348470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.348751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.349158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.349922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:47.350230 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:47.351856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:47.367373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1003/1994] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:47.370212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:47.384695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78028347-99e7-44fc-9c36-27ff1bcbb1b8 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:47.392385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111a30e-3141-40b5-b12c-4de594a3a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:47.399253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111a30e-3141-40b5-b12c-4de594a3a664 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.399253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111a30e-3141-40b5-b12c-4de594a3a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.399253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111a30e-3141-40b5-b12c-4de594a3a664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.399253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111a30e-3141-40b5-b12c-4de594a3a664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:47.399253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111a30e-3141-40b5-b12c-4de594a3a664 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:47.602644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 992/1995] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:47 2022] POST /identity/v3/projects => generated 359 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:47.603437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:47.616636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c285f-ea2f-46cb-a6e8-36423e9e05b5 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:47.690837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b5501-440e-45f7-988b-240a446dbfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:47.691579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5501-440e-45f7-988b-240a446dbfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.691850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5501-440e-45f7-988b-240a446dbfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.692123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5501-440e-45f7-988b-240a446dbfc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.692772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b5501-440e-45f7-988b-240a446dbfc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:47.695563 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b5501-440e-45f7-988b-240a446dbfc5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:47.882637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1004/1996] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:47 2022] POST /identity/v3/users => generated 280 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:47.886423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111a30e-3141-40b5-b12c-4de594a3a664 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:47.897459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111a30e-3141-40b5-b12c-4de594a3a664 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:47.902040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58a4e4-b7c1-4dd8-83e0-bdd75d9adce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:47.902698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58a4e4-b7c1-4dd8-83e0-bdd75d9adce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.902976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58a4e4-b7c1-4dd8-83e0-bdd75d9adce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.903238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58a4e4-b7c1-4dd8-83e0-bdd75d9adce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.903972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58a4e4-b7c1-4dd8-83e0-bdd75d9adce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:47.905603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58a4e4-b7c1-4dd8-83e0-bdd75d9adce7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:47.915920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 993/1997] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:47.917539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:47.925764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b5501-440e-45f7-988b-240a446dbfc5 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:47.937932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b5501-440e-45f7-988b-240a446dbfc5 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:47.942966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c980594-1da8-4ba4-a16c-d00b50e6709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:47.945589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980594-1da8-4ba4-a16c-d00b50e6709f admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.945951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980594-1da8-4ba4-a16c-d00b50e6709f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.946301 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980594-1da8-4ba4-a16c-d00b50e6709f admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:47.948575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c980594-1da8-4ba4-a16c-d00b50e6709f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:47.950067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c980594-1da8-4ba4-a16c-d00b50e6709f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:47.967962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1005/1998] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:47.972331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58a4e4-b7c1-4dd8-83e0-bdd75d9adce7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:47.985776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58a4e4-b7c1-4dd8-83e0-bdd75d9adce7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:47.995315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:47.997969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:47.998445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:47.998924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] PATH_INFO: `/v3/projects/34e5635bbe26416990809bf5e4c2b2bf/users/51493502163f44eface7928c4665ab32/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:48.017345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e5635bbe26416990809bf5e4c2b2bf, user_id=51493502163f44eface7928c4665ab32, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:48.020250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:48.138321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 994/1999] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:47 2022] PUT /identity/v3/projects/34e5635bbe26416990809bf5e4c2b2bf/users/51493502163f44eface7928c4665ab32/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:48.150498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7bcac-f46b-4cb3-8905-a9ccb8d6ff89 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:48.150719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7bcac-f46b-4cb3-8905-a9ccb8d6ff89 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:48.150944 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7bcac-f46b-4cb3-8905-a9ccb8d6ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:48.180499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-76f7bcac-f46b-4cb3-8905-a9ccb8d6ff89 None None] MFA Rules not processed for user `51493502163f44eface7928c4665ab32`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:48.181794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-76f7bcac-f46b-4cb3-8905-a9ccb8d6ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:48.251912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1006/2000] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:48.288582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:48.290321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:48.351874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc4293-af8f-4de6-80bc-a72b08835235 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:48.356177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8675387-4d37-48ef-ac6b-5eaea09d6fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:48.356810 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8675387-4d37-48ef-ac6b-5eaea09d6fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:48.357122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8675387-4d37-48ef-ac6b-5eaea09d6fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:48.357400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8675387-4d37-48ef-ac6b-5eaea09d6fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:48.366979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8675387-4d37-48ef-ac6b-5eaea09d6fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:48.368409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8675387-4d37-48ef-ac6b-5eaea09d6fa6 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:48.380722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 995/2001] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:48.400091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7bcac-f46b-4cb3-8905-a9ccb8d6ff89 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:48.470047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7bcac-f46b-4cb3-8905-a9ccb8d6ff89 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:48.474829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:48.475622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:48.475912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:48.476195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] PATH_INFO: `/v3/users/51493502163f44eface7928c4665ab32` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:48.477449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51493502163f44eface7928c4665ab32)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:48.479400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:48.752308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51493502163f44eface7928c4665ab32'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:48.759442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51493502163f44eface7928c4665ab32'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:48.858914 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51493502163f44eface7928c4665ab32'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:48.873777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51493502163f44eface7928c4665ab32'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:48.874873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f5b46a1b-96db-4ebd-b0fe-4b597475952f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51493502163f44eface7928c4665ab32'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:48.881531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1007/2002] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:48 2022] DELETE /identity/v3/users/51493502163f44eface7928c4665ab32 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:48.886542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16aa40-5705-4a3c-90a9-e59a1f3e97f8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:48.887652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16aa40-5705-4a3c-90a9-e59a1f3e97f8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:48.887652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16aa40-5705-4a3c-90a9-e59a1f3e97f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:48.917107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cd16aa40-5705-4a3c-90a9-e59a1f3e97f8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:48.918908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cd16aa40-5705-4a3c-90a9-e59a1f3e97f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:48.920455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670090d4-c315-4a31-a686-15b20b5224e2 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:48.920925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670090d4-c315-4a31-a686-15b20b5224e2 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:48.921017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670090d4-c315-4a31-a686-15b20b5224e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:48.941735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-670090d4-c315-4a31-a686-15b20b5224e2 None None] MFA Rules not processed for user `f3aab051a9174adbb9f22b84414e0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:48.943167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-670090d4-c315-4a31-a686-15b20b5224e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:48.995802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 996/2003] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:48.997215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c14f5-e3cd-424c-bd79-b66243464aa0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:48.997505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c14f5-e3cd-424c-bd79-b66243464aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:48.997782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c14f5-e3cd-424c-bd79-b66243464aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:49.003796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:49.023258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1008/2004] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:49.024586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670090d4-c315-4a31-a686-15b20b5224e2 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:49.028828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-670090d4-c315-4a31-a686-15b20b5224e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:49.038535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e03c14f5-e3cd-424c-bd79-b66243464aa0 None None] MFA Rules not processed for user `948a1e2233354b69ad6a4b42dbf2d9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:49.042002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e03c14f5-e3cd-424c-bd79-b66243464aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:49.048460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:49.128497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670090d4-c315-4a31-a686-15b20b5224e2 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:49.132959 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:49.133599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:49.133896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:49.134162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:49.144487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:49.150198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:49.158829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1009/2005] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:49.172238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 997/2006] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:49.179956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:49.179956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:49.198391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204dc3c-1276-45cb-aca6-c2bfd406e197 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:49.214270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947032-3659-4e96-88da-3196c4240ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:49.216755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947032-3659-4e96-88da-3196c4240ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:49.216755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947032-3659-4e96-88da-3196c4240ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:49.216993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947032-3659-4e96-88da-3196c4240ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:49.217697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947032-3659-4e96-88da-3196c4240ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:49.220024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947032-3659-4e96-88da-3196c4240ce1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:49.306445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1010/2007] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:49 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:49.311002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c14f5-e3cd-424c-bd79-b66243464aa0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:49.325965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c14f5-e3cd-424c-bd79-b66243464aa0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:49.394771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509983a-2bc1-408f-9daa-a6cb7369acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:49.395418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509983a-2bc1-408f-9daa-a6cb7369acd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:49.395695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509983a-2bc1-408f-9daa-a6cb7369acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:49.395993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509983a-2bc1-408f-9daa-a6cb7369acd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:49.396674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509983a-2bc1-408f-9daa-a6cb7369acd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:49.399823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509983a-2bc1-408f-9daa-a6cb7369acd4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:49.524081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 998/2008] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:49 2022] POST /identity/v3/users => generated 309 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:49.528187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947032-3659-4e96-88da-3196c4240ce1 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:49.538677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947032-3659-4e96-88da-3196c4240ce1 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:49.544571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0536-636f-433a-b2b2-a385ad49638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:49.545341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0536-636f-433a-b2b2-a385ad49638c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:49.545694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0536-636f-433a-b2b2-a385ad49638c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:49.545974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0536-636f-433a-b2b2-a385ad49638c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:49.546761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0536-636f-433a-b2b2-a385ad49638c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:49.548677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0536-636f-433a-b2b2-a385ad49638c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:49.560327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1011/2009] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:49.564644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509983a-2bc1-408f-9daa-a6cb7369acd4 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:49.577092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509983a-2bc1-408f-9daa-a6cb7369acd4 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:49.582249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479fe8f-3c14-4608-b7ba-2fffe42b963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:49.582975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fe8f-3c14-4608-b7ba-2fffe42b963c admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:49.583264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fe8f-3c14-4608-b7ba-2fffe42b963c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:49.583536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479fe8f-3c14-4608-b7ba-2fffe42b963c admin admin] PATH_INFO: `/v3/projects/ece548d72a8543b7a7dce1120397001e/users/3261715bd3c146b2b28932cbfe5fea35/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:49.598667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479fe8f-3c14-4608-b7ba-2fffe42b963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece548d72a8543b7a7dce1120397001e, user_id=3261715bd3c146b2b28932cbfe5fea35, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:49.601665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479fe8f-3c14-4608-b7ba-2fffe42b963c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:49.689574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 999/2010] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:49 2022] PUT /identity/v3/projects/ece548d72a8543b7a7dce1120397001e/users/3261715bd3c146b2b28932cbfe5fea35/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:49.693600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0536-636f-433a-b2b2-a385ad49638c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:49.705991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0536-636f-433a-b2b2-a385ad49638c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:49.795708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:49.796350 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:49.797234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:49.797234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:49.797904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:49.799560 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:49.810980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1012/2011] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:49.815293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479fe8f-3c14-4608-b7ba-2fffe42b963c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:49.826419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479fe8f-3c14-4608-b7ba-2fffe42b963c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:49.832066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d286a51-dde5-4841-a0c1-0308cb924425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:49.832671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d286a51-dde5-4841-a0c1-0308cb924425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:49.832975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d286a51-dde5-4841-a0c1-0308cb924425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:49.833249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d286a51-dde5-4841-a0c1-0308cb924425 admin admin] PATH_INFO: `/v3/projects/ece548d72a8543b7a7dce1120397001e/users/3261715bd3c146b2b28932cbfe5fea35/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:49.835418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d286a51-dde5-4841-a0c1-0308cb924425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece548d72a8543b7a7dce1120397001e, user_id=3261715bd3c146b2b28932cbfe5fea35, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:49.837183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:49.841667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d286a51-dde5-4841-a0c1-0308cb924425 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:49.850709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1000/2012] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:49 2022] PUT /identity/v3/projects/ece548d72a8543b7a7dce1120397001e/users/3261715bd3c146b2b28932cbfe5fea35/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:50.124383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:50.127118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:50.142389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50044f-4f5f-4348-b531-60a6de85f388 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:50.217243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:50.217899 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:50.218185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:50.218461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] PATH_INFO: `/v3/projects/34e5635bbe26416990809bf5e4c2b2bf` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:50.219627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e5635bbe26416990809bf5e4c2b2bf)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:50.221600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:50.311722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:50.359911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e5635bbe26416990809bf5e4c2b2bf', 'request_id': 'req-1becab08-4fb4-4396-8d23-dba83056f266'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:50.366715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e5635bbe26416990809bf5e4c2b2bf', 'request_id': 'req-1becab08-4fb4-4396-8d23-dba83056f266'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:50.504483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e5635bbe26416990809bf5e4c2b2bf', 'request_id': 'req-1becab08-4fb4-4396-8d23-dba83056f266'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:50.518993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] The token cache is being invalidate because project 34e5635bbe26416990809bf5e4c2b2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:50.519283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:50.519992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1becab08-4fb4-4396-8d23-dba83056f266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:50.521681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1013/2013] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:50 2022] DELETE /identity/v3/projects/34e5635bbe26416990809bf5e4c2b2bf => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:50.526925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537615e7-e868-45ae-bf8c-3f947b5f953b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:50.527537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537615e7-e868-45ae-bf8c-3f947b5f953b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:50.527933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537615e7-e868-45ae-bf8c-3f947b5f953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:50.558220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-537615e7-e868-45ae-bf8c-3f947b5f953b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:50.560609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-537615e7-e868-45ae-bf8c-3f947b5f953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:50.625904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1001/2014] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:50.634285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a5af-cbd0-40a5-abe7-85213f4b1fa1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:50.634571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a5af-cbd0-40a5-abe7-85213f4b1fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:50.634851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a5af-cbd0-40a5-abe7-85213f4b1fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:50.657423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-5d98a5af-cbd0-40a5-abe7-85213f4b1fa1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:50.658692 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5d98a5af-cbd0-40a5-abe7-85213f4b1fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:50.667407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1014/2015] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:50.672995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537615e7-e868-45ae-bf8c-3f947b5f953b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:50.684282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537615e7-e868-45ae-bf8c-3f947b5f953b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:50.689455 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:50.690102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:50.690381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:50.690653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:50.691387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:50.691692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:50.693346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:50.711141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1002/2016] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:50.712256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98a5af-cbd0-40a5-abe7-85213f4b1fa1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:50.723550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98a5af-cbd0-40a5-abe7-85213f4b1fa1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:50.728702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456a215-ad0b-40fe-bc30-609ebfe4ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:50.729368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a215-ad0b-40fe-bc30-609ebfe4ed95 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:50.729646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a215-ad0b-40fe-bc30-609ebfe4ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:50.729919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456a215-ad0b-40fe-bc30-609ebfe4ed95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:50.731229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456a215-ad0b-40fe-bc30-609ebfe4ed95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:50.733881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456a215-ad0b-40fe-bc30-609ebfe4ed95 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:50.935719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1015/2017] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:50 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:50.937695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:50.947443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b7001-caea-4981-8e0d-0fe9eec14370 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:51.010263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390cd2a-ca2e-4313-8a09-23b046796aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:51.010890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390cd2a-ca2e-4313-8a09-23b046796aba admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:51.011164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390cd2a-ca2e-4313-8a09-23b046796aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:51.011434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390cd2a-ca2e-4313-8a09-23b046796aba admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:51.013032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390cd2a-ca2e-4313-8a09-23b046796aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:51.015388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390cd2a-ca2e-4313-8a09-23b046796aba admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:51.126411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1003/2018] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:50 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:51.128022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456a215-ad0b-40fe-bc30-609ebfe4ed95 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:51.142216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456a215-ad0b-40fe-bc30-609ebfe4ed95 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:51.148644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebab15-2dbc-4b7c-ad06-6691078b06f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:51.149461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebab15-2dbc-4b7c-ad06-6691078b06f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:51.150940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebab15-2dbc-4b7c-ad06-6691078b06f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:51.150940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebab15-2dbc-4b7c-ad06-6691078b06f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:51.150940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebab15-2dbc-4b7c-ad06-6691078b06f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:51.153737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebab15-2dbc-4b7c-ad06-6691078b06f6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:51.168612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1016/2019] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:51.173125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390cd2a-ca2e-4313-8a09-23b046796aba admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:51.188233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390cd2a-ca2e-4313-8a09-23b046796aba admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:51.194181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca3ed-2de3-4a32-841c-92d1d86d8f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:51.195054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca3ed-2de3-4a32-841c-92d1d86d8f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:51.195550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca3ed-2de3-4a32-841c-92d1d86d8f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:51.195925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca3ed-2de3-4a32-841c-92d1d86d8f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:51.196740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca3ed-2de3-4a32-841c-92d1d86d8f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:51.198763 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca3ed-2de3-4a32-841c-92d1d86d8f54 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:51.211695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1004/2020] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:51.222984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebab15-2dbc-4b7c-ad06-6691078b06f6 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:51.229360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:51.234986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebab15-2dbc-4b7c-ad06-6691078b06f6 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:51.239808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:51.243988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:51.243988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:51.243988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] PATH_INFO: `/v3/projects/e72b946d3f26455bbf6d7330b0c2f5a2/users/320eaae091af4326888b57dded0e807d/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:51.257272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72b946d3f26455bbf6d7330b0c2f5a2, user_id=320eaae091af4326888b57dded0e807d, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:51.259974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:51.379499 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1017/2021] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:51 2022] PUT /identity/v3/projects/e72b946d3f26455bbf6d7330b0c2f5a2/users/320eaae091af4326888b57dded0e807d/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:51.385015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e75f1b-51d4-4e94-b23d-b69789f2abbf None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:51.385731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e75f1b-51d4-4e94-b23d-b69789f2abbf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:51.385731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e75f1b-51d4-4e94-b23d-b69789f2abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:51.408353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-45e75f1b-51d4-4e94-b23d-b69789f2abbf None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:51.410045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-45e75f1b-51d4-4e94-b23d-b69789f2abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:51.475525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1005/2022] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:51.485917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:51.487700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:51.551464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab02179-6180-4fc1-b35a-41e093578d23 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:51.555182 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97793b10-c6c4-45fe-bc56-d25412582877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:51.555791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97793b10-c6c4-45fe-bc56-d25412582877 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:51.556066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97793b10-c6c4-45fe-bc56-d25412582877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:51.556331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97793b10-c6c4-45fe-bc56-d25412582877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:51.566628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97793b10-c6c4-45fe-bc56-d25412582877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:51.568076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97793b10-c6c4-45fe-bc56-d25412582877 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:51.579535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1018/2023] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:51.760267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273e5c4-9e51-433f-8a8f-132dbad5993b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:51.760767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273e5c4-9e51-433f-8a8f-132dbad5993b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:51.761227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273e5c4-9e51-433f-8a8f-132dbad5993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:51.774356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:51.806518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7273e5c4-9e51-433f-8a8f-132dbad5993b None None] MFA Rules not processed for user `3261715bd3c146b2b28932cbfe5fea35`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:51.808181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7273e5c4-9e51-433f-8a8f-132dbad5993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:51.898846 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1006/2024] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:52.862268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8506d5-5ece-44f4-ba0f-c047dd11f4e0 None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:52.862816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8506d5-5ece-44f4-ba0f-c047dd11f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:52.862929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8506d5-5ece-44f4-ba0f-c047dd11f4e0 None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:52.864551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1019/2025] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:25:52.897742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8323-82fe-42af-8ccf-615f47585a24 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:52.898304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8323-82fe-42af-8ccf-615f47585a24 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:52.898882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8323-82fe-42af-8ccf-615f47585a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:52.922375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4efe8323-82fe-42af-8ccf-615f47585a24 None None] MFA Rules not processed for user `afab8bad046e462b9bd6188fa01720d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:52.924811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4efe8323-82fe-42af-8ccf-615f47585a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:52.956369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:53.002488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1007/2026] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:53.013617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8506d5-5ece-44f4-ba0f-c047dd11f4e0 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:53.016190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6c8506d5-5ece-44f4-ba0f-c047dd11f4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:53.035228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8506d5-5ece-44f4-ba0f-c047dd11f4e0 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:53.040239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:53.041111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:53.041464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:53.041800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:53.053197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:53.056755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:53.072752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1020/2027] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:53.407662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:53.514829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02fca-aa7b-4b49-bef5-e3d9c0e3d996 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:53.514829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02fca-aa7b-4b49-bef5-e3d9c0e3d996 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:53.514829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02fca-aa7b-4b49-bef5-e3d9c0e3d996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:53.549299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-83d02fca-aa7b-4b49-bef5-e3d9c0e3d996 None None] MFA Rules not processed for user `320eaae091af4326888b57dded0e807d`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:53.550715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-83d02fca-aa7b-4b49-bef5-e3d9c0e3d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:53.648511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1008/2028] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:53.661996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:53.663637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:53.754045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e51f87-f6b6-4034-99b8-f91b678717e6 service placement] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:53.756587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93eac81-7b3b-460d-9dc7-0917d22787ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:53.757824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eac81-7b3b-460d-9dc7-0917d22787ee service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:53.757824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eac81-7b3b-460d-9dc7-0917d22787ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:53.757824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eac81-7b3b-460d-9dc7-0917d22787ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:53.768771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93eac81-7b3b-460d-9dc7-0917d22787ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:53.770276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93eac81-7b3b-460d-9dc7-0917d22787ee service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:53.787965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1021/2029] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:25:53.811564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:54.017036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d02fca-aa7b-4b49-bef5-e3d9c0e3d996 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:54.020233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-83d02fca-aa7b-4b49-bef5-e3d9c0e3d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:54.049060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d02fca-aa7b-4b49-bef5-e3d9c0e3d996 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:54.056630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:54.057820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:54.058298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:54.059397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] PATH_INFO: `/v3/users/948a1e2233354b69ad6a4b42dbf2d9cc` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:54.061765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948a1e2233354b69ad6a4b42dbf2d9cc)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:54.065588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:54.334943 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948a1e2233354b69ad6a4b42dbf2d9cc'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:54.335115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948a1e2233354b69ad6a4b42dbf2d9cc'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:54.335710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948a1e2233354b69ad6a4b42dbf2d9cc'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:54.351947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948a1e2233354b69ad6a4b42dbf2d9cc'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:54.428190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948a1e2233354b69ad6a4b42dbf2d9cc'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:54.448245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1009/2030] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:54 2022] DELETE /identity/v3/users/948a1e2233354b69ad6a4b42dbf2d9cc => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:54.737523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:54.902820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93eac81-7b3b-460d-9dc7-0917d22787ee service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:54.914423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93eac81-7b3b-460d-9dc7-0917d22787ee service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:54.993278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:54.994306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:54.994790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:54.995133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] PATH_INFO: `/v3/projects/a0083939278247b0b8a43512d3e8e694` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:54.997317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0083939278247b0b8a43512d3e8e694)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:55.001418 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:55.118357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0083939278247b0b8a43512d3e8e694', 'request_id': 'req-e2a225b0-c10b-41b1-a473-c160debc42f0'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.126078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0083939278247b0b8a43512d3e8e694', 'request_id': 'req-e2a225b0-c10b-41b1-a473-c160debc42f0'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.230555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0083939278247b0b8a43512d3e8e694', 'request_id': 'req-e2a225b0-c10b-41b1-a473-c160debc42f0'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.247829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] The token cache is being invalidate because project a0083939278247b0b8a43512d3e8e694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:55.248162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.248973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e2a225b0-c10b-41b1-a473-c160debc42f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.250517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1022/2031] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:54 2022] DELETE /identity/v3/projects/a0083939278247b0b8a43512d3e8e694 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:55.254433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:55.255907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:55.274728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ad32d-4a85-46cc-b7fe-fc1d4814d0d3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:55.323770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:55.357850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:55.358587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:55.370383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:55.370383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] PATH_INFO: `/v3/users/3261715bd3c146b2b28932cbfe5fea35` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:55.370383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3261715bd3c146b2b28932cbfe5fea35)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:55.370383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:55.726603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdb524-793b-4bce-82b4-815e83442a0f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:55.727060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdb524-793b-4bce-82b4-815e83442a0f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:55.727558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdb524-793b-4bce-82b4-815e83442a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:55.732517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3261715bd3c146b2b28932cbfe5fea35'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.736046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3261715bd3c146b2b28932cbfe5fea35'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.736046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3261715bd3c146b2b28932cbfe5fea35'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.751631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3261715bd3c146b2b28932cbfe5fea35'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.770240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-23fdb524-793b-4bce-82b4-815e83442a0f None None] MFA Rules not processed for user `320eaae091af4326888b57dded0e807d`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:55.771506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-23fdb524-793b-4bce-82b4-815e83442a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:55.839530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1023/2032] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:55.842990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-125b71b9-2b69-4d70-9cbf-9eb767e5fbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3261715bd3c146b2b28932cbfe5fea35'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:55.865550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1010/2033] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:25:55 2022] DELETE /identity/v3/users/3261715bd3c146b2b28932cbfe5fea35 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:56.351360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdb524-793b-4bce-82b4-815e83442a0f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:56.352665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-23fdb524-793b-4bce-82b4-815e83442a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:56.371916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdb524-793b-4bce-82b4-815e83442a0f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:56.376221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:56.435477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:56.436060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:56.436343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:56.436619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] PATH_INFO: `/v3/projects/ece548d72a8543b7a7dce1120397001e` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:56.437870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece548d72a8543b7a7dce1120397001e)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:56.439789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:56.547535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece548d72a8543b7a7dce1120397001e', 'request_id': 'req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:56.553702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece548d72a8543b7a7dce1120397001e', 'request_id': 'req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:56.636737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece548d72a8543b7a7dce1120397001e', 'request_id': 'req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:56.650456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] The token cache is being invalidate because project ece548d72a8543b7a7dce1120397001e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:25:56.653431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:56.653431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-14b7e6f9-c6c2-4aa2-b17a-30d95b72080c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:25:56.653934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1024/2034] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:25:56 2022] DELETE /identity/v3/projects/ece548d72a8543b7a7dce1120397001e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:25:56.669100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e940f-a6a9-48b6-8c81-678e075c7986 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:56.669100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e940f-a6a9-48b6-8c81-678e075c7986 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:56.669100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e940f-a6a9-48b6-8c81-678e075c7986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:56.674103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:56.685542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-d27e940f-a6a9-48b6-8c81-678e075c7986 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:56.686706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d27e940f-a6a9-48b6-8c81-678e075c7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:56.747198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1011/2035] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:56.755105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a5004-1eba-4bb5-897a-7ac8c1b835ab None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:56.755398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a5004-1eba-4bb5-897a-7ac8c1b835ab None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:56.755677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a5004-1eba-4bb5-897a-7ac8c1b835ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:56.777053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ac9a5004-1eba-4bb5-897a-7ac8c1b835ab None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:56.779155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ac9a5004-1eba-4bb5-897a-7ac8c1b835ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:56.787205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1025/2036] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:56.791928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e940f-a6a9-48b6-8c81-678e075c7986 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:56.802449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e940f-a6a9-48b6-8c81-678e075c7986 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:56.806947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:56.807551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:56.807959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:56.808225 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:56.809258 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:25:56.809564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:56.811140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:56.822458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1012/2037] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:25:56.827159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a5004-1eba-4bb5-897a-7ac8c1b835ab None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:56.836753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a5004-1eba-4bb5-897a-7ac8c1b835ab None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:56.842593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59a402-bd8e-40b5-861c-ee032f849408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:56.845685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59a402-bd8e-40b5-861c-ee032f849408 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:56.845685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59a402-bd8e-40b5-861c-ee032f849408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:56.845685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59a402-bd8e-40b5-861c-ee032f849408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:56.845685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59a402-bd8e-40b5-861c-ee032f849408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:56.846767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59a402-bd8e-40b5-861c-ee032f849408 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:56.952507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1026/2038] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:56 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:56.956664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:56.967421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163bb8d-f228-4497-b151-255971d6617b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:57.024279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2a46d-fc04-43dc-bdb7-d13ce9849d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:57.025063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a46d-fc04-43dc-bdb7-d13ce9849d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.025345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a46d-fc04-43dc-bdb7-d13ce9849d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.025618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a46d-fc04-43dc-bdb7-d13ce9849d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.026287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2a46d-fc04-43dc-bdb7-d13ce9849d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:57.028767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2a46d-fc04-43dc-bdb7-d13ce9849d37 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:57.148049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1013/2039] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:56 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:25:57.151728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59a402-bd8e-40b5-861c-ee032f849408 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:57.164123 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59a402-bd8e-40b5-861c-ee032f849408 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:57.169378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958a9a9-4541-4892-9dad-17830fd08346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:57.170617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a9a9-4541-4892-9dad-17830fd08346 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.170953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a9a9-4541-4892-9dad-17830fd08346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.171251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a9a9-4541-4892-9dad-17830fd08346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.172002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958a9a9-4541-4892-9dad-17830fd08346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:57.173687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958a9a9-4541-4892-9dad-17830fd08346 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:57.189193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1027/2040] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:57.190580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2a46d-fc04-43dc-bdb7-d13ce9849d37 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:57.203077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2a46d-fc04-43dc-bdb7-d13ce9849d37 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:57.208238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e1354-e9d0-4e29-a081-291b947de9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:57.210251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e1354-e9d0-4e29-a081-291b947de9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.210251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e1354-e9d0-4e29-a081-291b947de9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.210251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e1354-e9d0-4e29-a081-291b947de9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.210251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e1354-e9d0-4e29-a081-291b947de9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:57.212150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e1354-e9d0-4e29-a081-291b947de9ec admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:57.224078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1014/2041] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:57.228394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958a9a9-4541-4892-9dad-17830fd08346 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:57.239336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958a9a9-4541-4892-9dad-17830fd08346 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:57.243915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5f420-c405-48cc-88ae-c32932285e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:57.244573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f420-c405-48cc-88ae-c32932285e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.244856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f420-c405-48cc-88ae-c32932285e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.245164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f420-c405-48cc-88ae-c32932285e09 admin admin] PATH_INFO: `/v3/projects/c53c16a8c9924f7f812ab7c414cb1379/users/6a2582c07565491ea12e6494c09d1d8f/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.259874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5f420-c405-48cc-88ae-c32932285e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53c16a8c9924f7f812ab7c414cb1379, user_id=6a2582c07565491ea12e6494c09d1d8f, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:57.263109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5f420-c405-48cc-88ae-c32932285e09 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:57.360618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1028/2042] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:57 2022] PUT /identity/v3/projects/c53c16a8c9924f7f812ab7c414cb1379/users/6a2582c07565491ea12e6494c09d1d8f/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:57.371259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce96d92-e713-4369-8e0f-f9e4c2769a9b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.371702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce96d92-e713-4369-8e0f-f9e4c2769a9b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.372533 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce96d92-e713-4369-8e0f-f9e4c2769a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.403419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1ce96d92-e713-4369-8e0f-f9e4c2769a9b None None] MFA Rules not processed for user `6a2582c07565491ea12e6494c09d1d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:57.405082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1ce96d92-e713-4369-8e0f-f9e4c2769a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:57.476471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1015/2043] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:25:57.481237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5f420-c405-48cc-88ae-c32932285e09 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:57.553395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5f420-c405-48cc-88ae-c32932285e09 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:57.559369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3754ea-6140-4746-9718-c4eaf6fda07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:57.560247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3754ea-6140-4746-9718-c4eaf6fda07c admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.560617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3754ea-6140-4746-9718-c4eaf6fda07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.560846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3754ea-6140-4746-9718-c4eaf6fda07c admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.561520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3754ea-6140-4746-9718-c4eaf6fda07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:57.563523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3754ea-6140-4746-9718-c4eaf6fda07c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:57.694972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1029/2044] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:25:57 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:57.698547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce96d92-e713-4369-8e0f-f9e4c2769a9b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:57.710118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce96d92-e713-4369-8e0f-f9e4c2769a9b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:57.739145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:57.766398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba25fe1-49cc-4c18-b35c-fe3bf70a544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:57.767023 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba25fe1-49cc-4c18-b35c-fe3bf70a544b admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.767302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba25fe1-49cc-4c18-b35c-fe3bf70a544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.767580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba25fe1-49cc-4c18-b35c-fe3bf70a544b admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.768248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba25fe1-49cc-4c18-b35c-fe3bf70a544b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:57.770214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba25fe1-49cc-4c18-b35c-fe3bf70a544b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:57.891752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1016/2045] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:25:57 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:25:57.896048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3754ea-6140-4746-9718-c4eaf6fda07c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:57.907121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3754ea-6140-4746-9718-c4eaf6fda07c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:57.911842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb061e84-9034-45ca-9f65-892803793021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:57.912555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb061e84-9034-45ca-9f65-892803793021 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.912834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb061e84-9034-45ca-9f65-892803793021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.913151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb061e84-9034-45ca-9f65-892803793021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.913837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb061e84-9034-45ca-9f65-892803793021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:57.915465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb061e84-9034-45ca-9f65-892803793021 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:57.926650 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1030/2046] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:57.930908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba25fe1-49cc-4c18-b35c-fe3bf70a544b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:57.941629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba25fe1-49cc-4c18-b35c-fe3bf70a544b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:57.946204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3947f-b087-41e3-932a-91d45212a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:57.946859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3947f-b087-41e3-932a-91d45212a04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:57.947132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3947f-b087-41e3-932a-91d45212a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:57.947549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3947f-b087-41e3-932a-91d45212a04f admin admin] PATH_INFO: `/v3/projects/9327737f5caa4264bc04612b55dad9d5/users/14c4bc891407414c816d1cc38839c68d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:57.962993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3947f-b087-41e3-932a-91d45212a04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9327737f5caa4264bc04612b55dad9d5, user_id=14c4bc891407414c816d1cc38839c68d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:57.966090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3947f-b087-41e3-932a-91d45212a04f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:58.082883 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:58.090938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1017/2047] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:57 2022] PUT /identity/v3/projects/9327737f5caa4264bc04612b55dad9d5/users/14c4bc891407414c816d1cc38839c68d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:58.095213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb061e84-9034-45ca-9f65-892803793021 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:58.105144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb061e84-9034-45ca-9f65-892803793021 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:58.161182 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4261a3-c1a5-4e41-b844-194d023b8ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:58.161795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4261a3-c1a5-4e41-b844-194d023b8ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:58.162078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4261a3-c1a5-4e41-b844-194d023b8ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:58.162346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4261a3-c1a5-4e41-b844-194d023b8ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:58.163047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4261a3-c1a5-4e41-b844-194d023b8ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:58.164664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4261a3-c1a5-4e41-b844-194d023b8ac5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:58.174929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1031/2048] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:25:58.179576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3947f-b087-41e3-932a-91d45212a04f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:58.191282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3947f-b087-41e3-932a-91d45212a04f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:58.195851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:58.196531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:58.196805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:58.197113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] PATH_INFO: `/v3/projects/9327737f5caa4264bc04612b55dad9d5/users/14c4bc891407414c816d1cc38839c68d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:58.199080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9327737f5caa4264bc04612b55dad9d5, user_id=14c4bc891407414c816d1cc38839c68d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:58.202182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:58.213473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1018/2049] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:25:58 2022] PUT /identity/v3/projects/9327737f5caa4264bc04612b55dad9d5/users/14c4bc891407414c816d1cc38839c68d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:25:58.226519 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629ef8-86b4-4454-aa01-f290909a3323 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:58.226811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629ef8-86b4-4454-aa01-f290909a3323 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:58.227090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629ef8-86b4-4454-aa01-f290909a3323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:58.260284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-73629ef8-86b4-4454-aa01-f290909a3323 None None] MFA Rules not processed for user `14c4bc891407414c816d1cc38839c68d`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:25:58.261588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-73629ef8-86b4-4454-aa01-f290909a3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:58.355686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1032/2050] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:25:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:25:58.363836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:58.365961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:25:58.427981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f815929-d105-486b-9976-9aa6c0566e6d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:58.431847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d59387-7ce1-4f4b-b8a5-a1b08d9adfd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:58.432474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59387-7ce1-4f4b-b8a5-a1b08d9adfd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:58.432752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59387-7ce1-4f4b-b8a5-a1b08d9adfd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:58.433072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59387-7ce1-4f4b-b8a5-a1b08d9adfd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:58.443816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d59387-7ce1-4f4b-b8a5-a1b08d9adfd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:58.445320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d59387-7ce1-4f4b-b8a5-a1b08d9adfd9 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:58.455801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1019/2051] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:58.810397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629ef8-86b4-4454-aa01-f290909a3323 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:25:58.820290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629ef8-86b4-4454-aa01-f290909a3323 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:25:58.825723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53775968-2313-4489-b4d1-d9e9c26acca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:25:58.826453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775968-2313-4489-b4d1-d9e9c26acca1 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:25:58.826709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775968-2313-4489-b4d1-d9e9c26acca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:25:58.827195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775968-2313-4489-b4d1-d9e9c26acca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:25:58.891439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53775968-2313-4489-b4d1-d9e9c26acca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:25:58.892956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53775968-2313-4489-b4d1-d9e9c26acca1 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:25:58.902355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1033/2052] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:25:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:25:58.943779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:25:59.245504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:00.567634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:01.214009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:01.309402 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:02.463698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:03.122532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:03.447593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:04.178944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:04.348397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:04.943564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:05.366266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:05.533720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:06.716841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:06.733935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:07.971209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d59387-7ce1-4f4b-b8a5-a1b08d9adfd9 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:08.033850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d59387-7ce1-4f4b-b8a5-a1b08d9adfd9 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:08.039249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:08.039938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:08.040224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:08.041269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] PATH_INFO: `/v3/users/6a2582c07565491ea12e6494c09d1d8f` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:08.042237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2582c07565491ea12e6494c09d1d8f)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:08.044601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:08.292796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2582c07565491ea12e6494c09d1d8f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:08.293663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2582c07565491ea12e6494c09d1d8f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:08.294340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2582c07565491ea12e6494c09d1d8f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:08.309660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2582c07565491ea12e6494c09d1d8f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:08.419599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2582c07565491ea12e6494c09d1d8f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:08.438475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1020/2053] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:07 2022] DELETE /identity/v3/users/6a2582c07565491ea12e6494c09d1d8f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:08.440073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be0b1-bc07-447a-8021-13677edee1ea None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:08.440489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be0b1-bc07-447a-8021-13677edee1ea None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:08.440813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be0b1-bc07-447a-8021-13677edee1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:08.460244 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-996be0b1-bc07-447a-8021-13677edee1ea None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:08.461693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-996be0b1-bc07-447a-8021-13677edee1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:08.531080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1034/2054] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:26:08.541041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:08.542520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:08.606116 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e937a-1a96-46d2-9211-228f701ac419 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:08.616029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac4b2-694a-4b64-afcc-912a78ef91f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:08.616664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac4b2-694a-4b64-afcc-912a78ef91f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:08.616973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac4b2-694a-4b64-afcc-912a78ef91f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:08.617248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac4b2-694a-4b64-afcc-912a78ef91f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:08.627947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bac4b2-694a-4b64-afcc-912a78ef91f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:08.629417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bac4b2-694a-4b64-afcc-912a78ef91f7 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:08.639696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1021/2055] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:08.790963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:08.836211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:09.095114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996be0b1-bc07-447a-8021-13677edee1ea None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:09.097371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-996be0b1-bc07-447a-8021-13677edee1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:09.111657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996be0b1-bc07-447a-8021-13677edee1ea None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:09.116589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:09.117362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:09.117643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:09.117941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] PATH_INFO: `/v3/projects/c53c16a8c9924f7f812ab7c414cb1379` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:09.119203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53c16a8c9924f7f812ab7c414cb1379)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:09.122358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:09.267345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53c16a8c9924f7f812ab7c414cb1379', 'request_id': 'req-866743bb-69b4-4136-8a88-78ba7698e1f2'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.273340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53c16a8c9924f7f812ab7c414cb1379', 'request_id': 'req-866743bb-69b4-4136-8a88-78ba7698e1f2'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.389960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53c16a8c9924f7f812ab7c414cb1379', 'request_id': 'req-866743bb-69b4-4136-8a88-78ba7698e1f2'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.413496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] The token cache is being invalidate because project c53c16a8c9924f7f812ab7c414cb1379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:09.413812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.414430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.416279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1035/2056] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:09 2022] DELETE /identity/v3/projects/c53c16a8c9924f7f812ab7c414cb1379 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:09.420863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac4b2-694a-4b64-afcc-912a78ef91f7 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:09.430593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac4b2-694a-4b64-afcc-912a78ef91f7 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:09.487879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:09.488567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:09.488849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:09.489263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] PATH_INFO: `/v3/users/14c4bc891407414c816d1cc38839c68d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:09.490485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c4bc891407414c816d1cc38839c68d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:09.492463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:09.717596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c4bc891407414c816d1cc38839c68d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.718260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c4bc891407414c816d1cc38839c68d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.718863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c4bc891407414c816d1cc38839c68d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.731934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c4bc891407414c816d1cc38839c68d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.824873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f38ca5d7-ce36-4bba-a195-9617c8d59d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c4bc891407414c816d1cc38839c68d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:09.838423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1022/2057] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:09 2022] DELETE /identity/v3/users/14c4bc891407414c816d1cc38839c68d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:10.477648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:10.477648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:10.492603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866743bb-69b4-4136-8a88-78ba7698e1f2 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:10.599309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:10.599981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:10.600259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:10.600532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] PATH_INFO: `/v3/projects/9327737f5caa4264bc04612b55dad9d5` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:10.601831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9327737f5caa4264bc04612b55dad9d5)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:10.604489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:10.720778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9327737f5caa4264bc04612b55dad9d5', 'request_id': 'req-76ed6125-8887-4ce7-8851-dc307aca6fad'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:10.727069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9327737f5caa4264bc04612b55dad9d5', 'request_id': 'req-76ed6125-8887-4ce7-8851-dc307aca6fad'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:10.842006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9327737f5caa4264bc04612b55dad9d5', 'request_id': 'req-76ed6125-8887-4ce7-8851-dc307aca6fad'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:10.855886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] The token cache is being invalidate because project 9327737f5caa4264bc04612b55dad9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:10.856580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:10.857097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-76ed6125-8887-4ce7-8851-dc307aca6fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:10.859101 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1036/2058] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:10 2022] DELETE /identity/v3/projects/9327737f5caa4264bc04612b55dad9d5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:10.864817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7a33-d02a-413b-b459-845be40d6f99 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:10.866233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7a33-d02a-413b-b459-845be40d6f99 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:10.866629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7a33-d02a-413b-b459-845be40d6f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:10.877328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:10.901810 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-022e7a33-d02a-413b-b459-845be40d6f99 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:10.903920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-022e7a33-d02a-413b-b459-845be40d6f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:11.004981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1023/2059] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:11.013214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a61a-50a8-4e21-a47d-f6388e007a6d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.013500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a61a-50a8-4e21-a47d-f6388e007a6d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.013778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a61a-50a8-4e21-a47d-f6388e007a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.034973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-2517a61a-50a8-4e21-a47d-f6388e007a6d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:11.036204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-2517a61a-50a8-4e21-a47d-f6388e007a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:11.047034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1037/2060] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:11.052265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7a33-d02a-413b-b459-845be40d6f99 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:11.063290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7a33-d02a-413b-b459-845be40d6f99 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:11.070038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:11.070806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.071151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.071676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.072537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:26:11.072844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:11.075481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:11.089945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1024/2061] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:26:11.095236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a61a-50a8-4e21-a47d-f6388e007a6d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:11.105763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a61a-50a8-4e21-a47d-f6388e007a6d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:11.111976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6b3e3-1f8a-40c8-9159-8a32b3fe35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:11.112617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6b3e3-1f8a-40c8-9159-8a32b3fe35c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.112925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6b3e3-1f8a-40c8-9159-8a32b3fe35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.113209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6b3e3-1f8a-40c8-9159-8a32b3fe35c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.113879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6b3e3-1f8a-40c8-9159-8a32b3fe35c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:11.115825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6b3e3-1f8a-40c8-9159-8a32b3fe35c8 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:11.244092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1038/2062] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:11 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:11.245271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:11.256251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b268-6c7e-4ebe-809d-3199656eb7d9 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:11.322363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394c0ef-f2c9-49a0-969e-158dffe64bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:11.323003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394c0ef-f2c9-49a0-969e-158dffe64bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.323287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394c0ef-f2c9-49a0-969e-158dffe64bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.323580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394c0ef-f2c9-49a0-969e-158dffe64bdf admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.324997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394c0ef-f2c9-49a0-969e-158dffe64bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:11.327124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394c0ef-f2c9-49a0-969e-158dffe64bdf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:11.430659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1025/2063] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:11 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:26:11.435773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6b3e3-1f8a-40c8-9159-8a32b3fe35c8 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:11.450513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6b3e3-1f8a-40c8-9159-8a32b3fe35c8 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:11.456109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0015-4d33-4641-be96-1faab667a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:11.456834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0015-4d33-4641-be96-1faab667a275 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.457232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0015-4d33-4641-be96-1faab667a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.457618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0015-4d33-4641-be96-1faab667a275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.458707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0015-4d33-4641-be96-1faab667a275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:11.462198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0015-4d33-4641-be96-1faab667a275 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:11.473087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1039/2064] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:26:11.477238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394c0ef-f2c9-49a0-969e-158dffe64bdf admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:11.491236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394c0ef-f2c9-49a0-969e-158dffe64bdf admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:11.497338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef685e9-7037-4905-8d18-4dfaf2901493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:11.498002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef685e9-7037-4905-8d18-4dfaf2901493 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.498289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef685e9-7037-4905-8d18-4dfaf2901493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.498563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef685e9-7037-4905-8d18-4dfaf2901493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.499317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef685e9-7037-4905-8d18-4dfaf2901493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:11.501035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef685e9-7037-4905-8d18-4dfaf2901493 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:11.515675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1026/2065] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:11.523049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0015-4d33-4641-be96-1faab667a275 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:11.536548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0015-4d33-4641-be96-1faab667a275 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:11.541869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754a040-b94f-44f8-9551-c3c69ee0efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:11.542724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a040-b94f-44f8-9551-c3c69ee0efd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.543653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a040-b94f-44f8-9551-c3c69ee0efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.543653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a040-b94f-44f8-9551-c3c69ee0efd4 admin admin] PATH_INFO: `/v3/projects/269baef85887403ab490f3d20b9620b1/users/f265fecd37be4620851067ccaab21f47/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.560825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754a040-b94f-44f8-9551-c3c69ee0efd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269baef85887403ab490f3d20b9620b1, user_id=f265fecd37be4620851067ccaab21f47, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:11.563603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754a040-b94f-44f8-9551-c3c69ee0efd4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:11.631718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1040/2066] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:11 2022] PUT /identity/v3/projects/269baef85887403ab490f3d20b9620b1/users/f265fecd37be4620851067ccaab21f47/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:11.643295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18753ecd-6758-44bb-a205-533561a8f0cd None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.643668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18753ecd-6758-44bb-a205-533561a8f0cd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.644334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18753ecd-6758-44bb-a205-533561a8f0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.682316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-18753ecd-6758-44bb-a205-533561a8f0cd None None] MFA Rules not processed for user `f265fecd37be4620851067ccaab21f47`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:11.684298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-18753ecd-6758-44bb-a205-533561a8f0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:11.762902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1027/2067] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:11.766791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:11.768271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754a040-b94f-44f8-9551-c3c69ee0efd4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:11.848054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754a040-b94f-44f8-9551-c3c69ee0efd4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:11.857476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:11.859007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:11.859476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:11.859953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:11.860951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:11.863062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:11.992802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1041/2068] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:11 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:11.997090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18753ecd-6758-44bb-a205-533561a8f0cd None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.008052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18753ecd-6758-44bb-a205-533561a8f0cd None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:12.028613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.030888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:12.099357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ac8e-a353-4bd4-8731-835e3a7a70f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:12.100367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ac8e-a353-4bd4-8731-835e3a7a70f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.100827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ac8e-a353-4bd4-8731-835e3a7a70f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.101132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ac8e-a353-4bd4-8731-835e3a7a70f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.101796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142ac8e-a353-4bd4-8731-835e3a7a70f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:12.105926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142ac8e-a353-4bd4-8731-835e3a7a70f5 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:12.124816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287e2d-a062-43e3-a32d-36760c3749bb admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:12.129815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:12.130838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.131126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.131398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] PATH_INFO: `/v3/users/e6aa6f2499e94529ad4fef4924d1f1ab` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.132582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6aa6f2499e94529ad4fef4924d1f1ab)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:12.134578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:12.254499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1028/2069] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:11 2022] POST /identity/v3/users => generated 300 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:12.258282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ac8e-a353-4bd4-8731-835e3a7a70f5 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.284217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ac8e-a353-4bd4-8731-835e3a7a70f5 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:12.290539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f71c2b-6450-4113-8071-a28d0fc209fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:12.291154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f71c2b-6450-4113-8071-a28d0fc209fd admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.291432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f71c2b-6450-4113-8071-a28d0fc209fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.291706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f71c2b-6450-4113-8071-a28d0fc209fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.292400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f71c2b-6450-4113-8071-a28d0fc209fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:12.311847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f71c2b-6450-4113-8071-a28d0fc209fd admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:12.311847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1029/2070] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:12.312913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f71c2b-6450-4113-8071-a28d0fc209fd admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.332262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f71c2b-6450-4113-8071-a28d0fc209fd admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:12.337495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d57ab-0e20-4e2e-a270-16e12bbd784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:12.338181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d57ab-0e20-4e2e-a270-16e12bbd784a admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.338863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d57ab-0e20-4e2e-a270-16e12bbd784a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.338863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d57ab-0e20-4e2e-a270-16e12bbd784a admin admin] PATH_INFO: `/v3/projects/7b557a3decde4f9898023f219803197d/users/5a4496de6c2c4ddb97d86064edaf0133/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.360206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d57ab-0e20-4e2e-a270-16e12bbd784a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b557a3decde4f9898023f219803197d, user_id=5a4496de6c2c4ddb97d86064edaf0133, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:12.363322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d57ab-0e20-4e2e-a270-16e12bbd784a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:12.433752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6aa6f2499e94529ad4fef4924d1f1ab'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:12.437731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1030/2071] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:12 2022] PUT /identity/v3/projects/7b557a3decde4f9898023f219803197d/users/5a4496de6c2c4ddb97d86064edaf0133/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:12.442079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d57ab-0e20-4e2e-a270-16e12bbd784a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.453005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6aa6f2499e94529ad4fef4924d1f1ab'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:12.519776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d57ab-0e20-4e2e-a270-16e12bbd784a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:12.529515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3e16a-618a-4525-8a66-a2ba7cd90f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:12.530153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e16a-618a-4525-8a66-a2ba7cd90f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.530461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e16a-618a-4525-8a66-a2ba7cd90f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.530786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3e16a-618a-4525-8a66-a2ba7cd90f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.531515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3e16a-618a-4525-8a66-a2ba7cd90f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:12.533190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3e16a-618a-4525-8a66-a2ba7cd90f3a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:12.543929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1031/2072] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:12.548501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3e16a-618a-4525-8a66-a2ba7cd90f3a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.561407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6aa6f2499e94529ad4fef4924d1f1ab'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:12.566222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3e16a-618a-4525-8a66-a2ba7cd90f3a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:12.569245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5edfd-51c8-4e5c-b4a6-7cdefcd3d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:12.569932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5edfd-51c8-4e5c-b4a6-7cdefcd3d65b admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.570262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5edfd-51c8-4e5c-b4a6-7cdefcd3d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.570537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5edfd-51c8-4e5c-b4a6-7cdefcd3d65b admin admin] PATH_INFO: `/v3/projects/7b557a3decde4f9898023f219803197d/users/5a4496de6c2c4ddb97d86064edaf0133/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.573436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5edfd-51c8-4e5c-b4a6-7cdefcd3d65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b557a3decde4f9898023f219803197d, user_id=5a4496de6c2c4ddb97d86064edaf0133, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:12.577420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5edfd-51c8-4e5c-b4a6-7cdefcd3d65b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:12.578522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6aa6f2499e94529ad4fef4924d1f1ab'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:12.579301 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6aa6f2499e94529ad4fef4924d1f1ab'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:12.593124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1032/2074] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:12 2022] PUT /identity/v3/projects/7b557a3decde4f9898023f219803197d/users/5a4496de6c2c4ddb97d86064edaf0133/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:12.600131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1042/2074] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:12 2022] DELETE /identity/v3/users/e6aa6f2499e94529ad4fef4924d1f1ab => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:12.603418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d0948-527a-4775-baec-65862cac7409 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.603855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d0948-527a-4775-baec-65862cac7409 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.604336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d0948-527a-4775-baec-65862cac7409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.648789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ae0d0948-527a-4775-baec-65862cac7409 None None] MFA Rules not processed for user `5a4496de6c2c4ddb97d86064edaf0133`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:12.650153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ae0d0948-527a-4775-baec-65862cac7409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:12.796807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1033/2075] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:12.812626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.818879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:12.879467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d0948-527a-4775-baec-65862cac7409 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.881027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ae0d0948-527a-4775-baec-65862cac7409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:12.884167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06715d-f781-46fb-8263-80121acf516d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:12.889912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:12.890353 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.890611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.890885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.908465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:12.911297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:12.943898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1043/2076] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:12.976800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d0948-527a-4775-baec-65862cac7409 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:12.980611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:12.982263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:12.983971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:12.984658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:12.984977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:12.985256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] PATH_INFO: `/v3/projects/42fa6adc81af4f5cbe3fd91f2f3cd6ce` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:12.986690 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fa6adc81af4f5cbe3fd91f2f3cd6ce)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:12.990626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:13.000026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0a8ac-fa5b-4df4-84f4-73c19f8c4f20 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:13.005978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:13.006863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:13.007209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:13.007567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] PATH_INFO: `/v3/users/f265fecd37be4620851067ccaab21f47` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:13.008874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f265fecd37be4620851067ccaab21f47)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:13.010920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:13.171383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:13.209742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f265fecd37be4620851067ccaab21f47'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.214442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fa6adc81af4f5cbe3fd91f2f3cd6ce', 'request_id': 'req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.217484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f265fecd37be4620851067ccaab21f47'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.220822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fa6adc81af4f5cbe3fd91f2f3cd6ce', 'request_id': 'req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.304575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f265fecd37be4620851067ccaab21f47'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.320875 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f265fecd37be4620851067ccaab21f47'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.321916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-40ec550c-9b81-41e7-b83e-b6f9baa72923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f265fecd37be4620851067ccaab21f47'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.330812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1044/2077] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:12 2022] DELETE /identity/v3/users/f265fecd37be4620851067ccaab21f47 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:13.335149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628827d-1e94-4ac5-9f8f-48f486439325 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:13.335917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628827d-1e94-4ac5-9f8f-48f486439325 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:13.336351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628827d-1e94-4ac5-9f8f-48f486439325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:13.358282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-a628827d-1e94-4ac5-9f8f-48f486439325 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:13.359513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a628827d-1e94-4ac5-9f8f-48f486439325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:13.361672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fa6adc81af4f5cbe3fd91f2f3cd6ce', 'request_id': 'req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.379702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] The token cache is being invalidate because project 42fa6adc81af4f5cbe3fd91f2f3cd6ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:13.379997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.380959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.385822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1034/2078] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:12 2022] DELETE /identity/v3/projects/42fa6adc81af4f5cbe3fd91f2f3cd6ce => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:13.388075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:13.394374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:13.443226 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1045/2079] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:13.463342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628827d-1e94-4ac5-9f8f-48f486439325 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:13.463342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a628827d-1e94-4ac5-9f8f-48f486439325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:13.484058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ecb7a-8067-4db4-9134-1462c0c8e97e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:13.489527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:13.490235 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:13.490573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:13.490886 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] PATH_INFO: `/v3/users/b4de9da5c75f4763bc8e37419f04c053` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:13.492163 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4de9da5c75f4763bc8e37419f04c053)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:13.494353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:13.532934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628827d-1e94-4ac5-9f8f-48f486439325 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:13.537634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:13.538289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:13.538742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:13.539023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:13.551033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:13.552616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:13.567991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1046/2080] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:13.945842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4de9da5c75f4763bc8e37419f04c053'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.948621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4de9da5c75f4763bc8e37419f04c053'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.950573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4de9da5c75f4763bc8e37419f04c053'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:13.964336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4de9da5c75f4763bc8e37419f04c053'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.024305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4de9da5c75f4763bc8e37419f04c053'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.037711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1035/2081] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:13 2022] DELETE /identity/v3/users/b4de9da5c75f4763bc8e37419f04c053 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:14.106576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:14.110130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:14.128183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ff8e4-830a-4a72-b9fa-d96aadac58ed service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:14.193192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:14.204486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:14.204486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:14.204486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:14.204486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] PATH_INFO: `/v3/projects/269baef85887403ab490f3d20b9620b1` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:14.204813 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269baef85887403ab490f3d20b9620b1)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:14.205266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:14.316459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269baef85887403ab490f3d20b9620b1', 'request_id': 'req-91ce1e3d-7090-4992-84df-5a6f2d2afed8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.321727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269baef85887403ab490f3d20b9620b1', 'request_id': 'req-91ce1e3d-7090-4992-84df-5a6f2d2afed8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.340696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:14.342236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:14.360377 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd34c6-d34b-4cc8-a5cc-9444f032e553 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:14.424852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269baef85887403ab490f3d20b9620b1', 'request_id': 'req-91ce1e3d-7090-4992-84df-5a6f2d2afed8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.427099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:14.427739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:14.428056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:14.428327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] PATH_INFO: `/v3/projects/28b0d1dc33f54cb7b3a5ae923f335f58` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:14.434435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b0d1dc33f54cb7b3a5ae923f335f58)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:14.434435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:14.441619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] The token cache is being invalidate because project 269baef85887403ab490f3d20b9620b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:14.442036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.442898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.444758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1047/2082] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:14 2022] DELETE /identity/v3/projects/269baef85887403ab490f3d20b9620b1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:14.450227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:14.451736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:14.467820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1e3d-7090-4992-84df-5a6f2d2afed8 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:14.473631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:14.474449 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:14.474797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:14.475195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] PATH_INFO: `/v3/users/5a4496de6c2c4ddb97d86064edaf0133` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:14.476683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4496de6c2c4ddb97d86064edaf0133)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:14.479028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:14.548437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b0d1dc33f54cb7b3a5ae923f335f58', 'request_id': 'req-1a403323-6296-421d-9b4a-1b17b399a79a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.554740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b0d1dc33f54cb7b3a5ae923f335f58', 'request_id': 'req-1a403323-6296-421d-9b4a-1b17b399a79a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.607818 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b0d1dc33f54cb7b3a5ae923f335f58', 'request_id': 'req-1a403323-6296-421d-9b4a-1b17b399a79a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.627498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] The token cache is being invalidate because project 28b0d1dc33f54cb7b3a5ae923f335f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:14.627498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.627498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1a403323-6296-421d-9b4a-1b17b399a79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.627498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1036/2083] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:14 2022] DELETE /identity/v3/projects/28b0d1dc33f54cb7b3a5ae923f335f58 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:14.627498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d3ce-f736-49a7-9d58-6ee492637d9a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:14.628005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d3ce-f736-49a7-9d58-6ee492637d9a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:14.628005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49d3ce-f736-49a7-9d58-6ee492637d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:14.646869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-af49d3ce-f736-49a7-9d58-6ee492637d9a None None] MFA Rules not processed for user `f3aab051a9174adbb9f22b84414e0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:14.648354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-af49d3ce-f736-49a7-9d58-6ee492637d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:14.654066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4496de6c2c4ddb97d86064edaf0133'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.662327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4496de6c2c4ddb97d86064edaf0133'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.710000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1037/2084] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:14.711528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8b0b-a3d2-424e-a951-4880d60a0a69 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:14.711813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8b0b-a3d2-424e-a951-4880d60a0a69 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:14.712121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8b0b-a3d2-424e-a951-4880d60a0a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:14.735261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7e3b8b0b-a3d2-424e-a951-4880d60a0a69 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:14.736474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7e3b8b0b-a3d2-424e-a951-4880d60a0a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:14.750084 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4496de6c2c4ddb97d86064edaf0133'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.764416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4496de6c2c4ddb97d86064edaf0133'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.765210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6c61b23c-2224-414a-bc2b-ecf37725ddc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4496de6c2c4ddb97d86064edaf0133'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:14.772850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1048/2085] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:14 2022] DELETE /identity/v3/users/5a4496de6c2c4ddb97d86064edaf0133 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:14.817051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1038/2086] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:14.819649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff47c-ca45-4a48-aa5f-c0f5e8a5b527 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:14.820139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff47c-ca45-4a48-aa5f-c0f5e8a5b527 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:14.820453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff47c-ca45-4a48-aa5f-c0f5e8a5b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:14.828291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:14.846357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-232ff47c-ca45-4a48-aa5f-c0f5e8a5b527 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:14.847589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-232ff47c-ca45-4a48-aa5f-c0f5e8a5b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:14.926323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1049/2087] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:26:14.931085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b8b0b-a3d2-424e-a951-4880d60a0a69 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:14.966118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b8b0b-a3d2-424e-a951-4880d60a0a69 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:14.981170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:14.982042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:14.982509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:14.982845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:14.983711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:26:14.984015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:14.985735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.000446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1039/2088] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:26:15.004597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ff47c-ca45-4a48-aa5f-c0f5e8a5b527 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.015453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ff47c-ca45-4a48-aa5f-c0f5e8a5b527 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.024470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5aade-97df-425c-a8e9-5ccf94a152ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.025156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5aade-97df-425c-a8e9-5ccf94a152ee admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.025440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5aade-97df-425c-a8e9-5ccf94a152ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.025715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5aade-97df-425c-a8e9-5ccf94a152ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.026486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5aade-97df-425c-a8e9-5ccf94a152ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.029334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5aade-97df-425c-a8e9-5ccf94a152ee admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.133274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1050/2089] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:15 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:15.142520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.163833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311d9c0-5f76-4015-8ebb-d2eca5693bde admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.219538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:15.242666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfda87-7a5b-4b09-999e-f598f6ab7a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.244984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfda87-7a5b-4b09-999e-f598f6ab7a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.246893 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfda87-7a5b-4b09-999e-f598f6ab7a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.247953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfda87-7a5b-4b09-999e-f598f6ab7a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.249094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfda87-7a5b-4b09-999e-f598f6ab7a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.253166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfda87-7a5b-4b09-999e-f598f6ab7a6a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.334062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1040/2090] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:15 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:26:15.338340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5aade-97df-425c-a8e9-5ccf94a152ee admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.349666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5aade-97df-425c-a8e9-5ccf94a152ee admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.360571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc52fd-ddb8-4920-9e15-04eb4bdb27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.360571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc52fd-ddb8-4920-9e15-04eb4bdb27db admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.360571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc52fd-ddb8-4920-9e15-04eb4bdb27db admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.360571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc52fd-ddb8-4920-9e15-04eb4bdb27db admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.361008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc52fd-ddb8-4920-9e15-04eb4bdb27db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.361008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc52fd-ddb8-4920-9e15-04eb4bdb27db admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.372929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1051/2091] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:15.374668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfda87-7a5b-4b09-999e-f598f6ab7a6a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.385675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfda87-7a5b-4b09-999e-f598f6ab7a6a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.391433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.391843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.392219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.392495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.393255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.395409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.418247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1041/2092] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:15.418628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc52fd-ddb8-4920-9e15-04eb4bdb27db admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.419853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.421958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:15.423347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc52fd-ddb8-4920-9e15-04eb4bdb27db admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.424050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:15.431119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dff22-054e-4483-a176-ea5b242e2f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.431896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dff22-054e-4483-a176-ea5b242e2f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.438311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7fa7a-5912-4d21-9eb3-572b5ac99f08 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.443414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.450837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dff22-054e-4483-a176-ea5b242e2f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.451423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.451739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dff22-054e-4483-a176-ea5b242e2f27 admin admin] PATH_INFO: `/v3/projects/870df42f2e884ae39ca1391205ece401/users/7f704365cd13447bb52a8f21365def41/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.451833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.451833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] PATH_INFO: `/v3/projects/7b557a3decde4f9898023f219803197d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.451833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b557a3decde4f9898023f219803197d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.451833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.463952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dff22-054e-4483-a176-ea5b242e2f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=870df42f2e884ae39ca1391205ece401, user_id=7f704365cd13447bb52a8f21365def41, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.467597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dff22-054e-4483-a176-ea5b242e2f27 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.546066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:15.606602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1052/2093] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:15 2022] PUT /identity/v3/projects/870df42f2e884ae39ca1391205ece401/users/7f704365cd13447bb52a8f21365def41/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:15.617201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabdc9d-ffd7-49c6-ab15-9a402c4f5b0a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.618080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabdc9d-ffd7-49c6-ab15-9a402c4f5b0a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.619098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabdc9d-ffd7-49c6-ab15-9a402c4f5b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.621654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b557a3decde4f9898023f219803197d', 'request_id': 'req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:15.635943 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b557a3decde4f9898023f219803197d', 'request_id': 'req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:15.661666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-4eabdc9d-ffd7-49c6-ab15-9a402c4f5b0a None None] MFA Rules not processed for user `7f704365cd13447bb52a8f21365def41`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:15.664343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4eabdc9d-ffd7-49c6-ab15-9a402c4f5b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:15.732951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1053/2094] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:15.742311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b557a3decde4f9898023f219803197d', 'request_id': 'req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:15.744503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabdc9d-ffd7-49c6-ab15-9a402c4f5b0a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.746403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4eabdc9d-ffd7-49c6-ab15-9a402c4f5b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:15.755254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] The token cache is being invalidate because project 7b557a3decde4f9898023f219803197d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:15.761776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:15.761776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f9b9c428-7b7c-4b78-aad7-29f7c5f2c5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:15.761776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1042/2095] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:15 2022] DELETE /identity/v3/projects/7b557a3decde4f9898023f219803197d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:15.765433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c5a71-c089-4126-aad1-c43ebcb72b9b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.765796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c5a71-c089-4126-aad1-c43ebcb72b9b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.766163 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c5a71-c089-4126-aad1-c43ebcb72b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.788191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b19c5a71-c089-4126-aad1-c43ebcb72b9b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:15.789435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b19c5a71-c089-4126-aad1-c43ebcb72b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:15.806443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabdc9d-ffd7-49c6-ab15-9a402c4f5b0a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.810513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a3688-beba-4ef1-92dd-78bfaf7d921e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.811136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3688-beba-4ef1-92dd-78bfaf7d921e service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.811416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3688-beba-4ef1-92dd-78bfaf7d921e service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.811690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3688-beba-4ef1-92dd-78bfaf7d921e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.813536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-248a3688-beba-4ef1-92dd-78bfaf7d921e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:15.825706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a3688-beba-4ef1-92dd-78bfaf7d921e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.828169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a3688-beba-4ef1-92dd-78bfaf7d921e service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.838448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1054/2096] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:26:15.856944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1043/2097] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:15.861239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6da08-d6a5-4f89-bad7-3848bd91be8e None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.861526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6da08-d6a5-4f89-bad7-3848bd91be8e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.861829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6da08-d6a5-4f89-bad7-3848bd91be8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.903911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-e7f6da08-d6a5-4f89-bad7-3848bd91be8e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:15.905082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e7f6da08-d6a5-4f89-bad7-3848bd91be8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:15.914121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1055/2098] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:15.920262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c5a71-c089-4126-aad1-c43ebcb72b9b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.933061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c5a71-c089-4126-aad1-c43ebcb72b9b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.938322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.939056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.939395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.939722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.940483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:26:15.940847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.942531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:15.955624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1044/2099] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:26:15.960333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6da08-d6a5-4f89-bad7-3848bd91be8e None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:15.975651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6da08-d6a5-4f89-bad7-3848bd91be8e None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:15.982877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e05be4-0312-49d5-afea-790cedbe49cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:15.984263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e05be4-0312-49d5-afea-790cedbe49cb admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:15.984612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e05be4-0312-49d5-afea-790cedbe49cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:15.984998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e05be4-0312-49d5-afea-790cedbe49cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:15.985793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e05be4-0312-49d5-afea-790cedbe49cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:15.988396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e05be4-0312-49d5-afea-790cedbe49cb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:16.107417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1056/2100] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:15 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:16.111971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:16.129820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59523fa7-50d6-4405-8edd-f36a7282fb2a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:16.194479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6883b-10b1-4836-996d-1bfcc532f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:16.195106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6883b-10b1-4836-996d-1bfcc532f0cf admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:16.195384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6883b-10b1-4836-996d-1bfcc532f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:16.195654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6883b-10b1-4836-996d-1bfcc532f0cf admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:16.196315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6883b-10b1-4836-996d-1bfcc532f0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:16.198308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6883b-10b1-4836-996d-1bfcc532f0cf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:16.286471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1045/2101] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:16 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:16.290613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e05be4-0312-49d5-afea-790cedbe49cb admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:16.303187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e05be4-0312-49d5-afea-790cedbe49cb admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:16.309614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8fa68-4121-4990-9f4a-b20cdae03b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:16.310337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8fa68-4121-4990-9f4a-b20cdae03b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:16.310686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8fa68-4121-4990-9f4a-b20cdae03b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:16.311057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8fa68-4121-4990-9f4a-b20cdae03b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:16.311761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8fa68-4121-4990-9f4a-b20cdae03b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:16.313565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8fa68-4121-4990-9f4a-b20cdae03b40 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:16.325080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1057/2102] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:26:16.329062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6883b-10b1-4836-996d-1bfcc532f0cf admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:16.350569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6883b-10b1-4836-996d-1bfcc532f0cf admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:16.356276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee98b18-54a6-4d37-b9ff-9c5fb9a0b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:16.356960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98b18-54a6-4d37-b9ff-9c5fb9a0b546 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:16.357240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98b18-54a6-4d37-b9ff-9c5fb9a0b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:16.357512 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98b18-54a6-4d37-b9ff-9c5fb9a0b546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:16.358253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee98b18-54a6-4d37-b9ff-9c5fb9a0b546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:16.359872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee98b18-54a6-4d37-b9ff-9c5fb9a0b546 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:16.370842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1046/2103] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:26:16.375138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8fa68-4121-4990-9f4a-b20cdae03b40 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:16.385313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8fa68-4121-4990-9f4a-b20cdae03b40 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:16.390121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425616c2-7d2a-4607-b524-abf75b254a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:16.390779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425616c2-7d2a-4607-b524-abf75b254a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:16.391072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425616c2-7d2a-4607-b524-abf75b254a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:16.391354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425616c2-7d2a-4607-b524-abf75b254a0f admin admin] PATH_INFO: `/v3/projects/ce48d244360b4221896ad6d75fe2ebdc/users/9c9e22f52e86475695f929ec326362de/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:16.407359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425616c2-7d2a-4607-b524-abf75b254a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce48d244360b4221896ad6d75fe2ebdc, user_id=9c9e22f52e86475695f929ec326362de, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:16.410656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425616c2-7d2a-4607-b524-abf75b254a0f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:16.517458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1058/2104] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:16 2022] PUT /identity/v3/projects/ce48d244360b4221896ad6d75fe2ebdc/users/9c9e22f52e86475695f929ec326362de/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:16.530721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa07fb-8fed-4da5-8eb6-231e32d80004 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:16.531624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa07fb-8fed-4da5-8eb6-231e32d80004 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:16.531624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa07fb-8fed-4da5-8eb6-231e32d80004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:16.563755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3daa07fb-8fed-4da5-8eb6-231e32d80004 None None] MFA Rules not processed for user `9c9e22f52e86475695f929ec326362de`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:16.565025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3daa07fb-8fed-4da5-8eb6-231e32d80004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:16.639849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1047/2105] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:16.644498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425616c2-7d2a-4607-b524-abf75b254a0f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:16.734089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425616c2-7d2a-4607-b524-abf75b254a0f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:16.739442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b371ef-1cd7-4469-ada2-25cee8711a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:16.740073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b371ef-1cd7-4469-ada2-25cee8711a45 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:16.740355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b371ef-1cd7-4469-ada2-25cee8711a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:16.740628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b371ef-1cd7-4469-ada2-25cee8711a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:16.741631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b371ef-1cd7-4469-ada2-25cee8711a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:16.743886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b371ef-1cd7-4469-ada2-25cee8711a45 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:16.767890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:16.826310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:16.833837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1059/2106] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:16 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:16.837761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa07fb-8fed-4da5-8eb6-231e32d80004 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:16.849387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa07fb-8fed-4da5-8eb6-231e32d80004 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:16.906977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e991b0-378b-4c56-a49c-9bc2fd30449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:16.907597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e991b0-378b-4c56-a49c-9bc2fd30449a admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:16.907878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e991b0-378b-4c56-a49c-9bc2fd30449a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:16.908154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e991b0-378b-4c56-a49c-9bc2fd30449a admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:16.908799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e991b0-378b-4c56-a49c-9bc2fd30449a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:16.910843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e991b0-378b-4c56-a49c-9bc2fd30449a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:17.042188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1048/2107] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:16 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:26:17.047950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b371ef-1cd7-4469-ada2-25cee8711a45 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:17.058851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b371ef-1cd7-4469-ada2-25cee8711a45 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:17.063593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec89f-c4ce-4387-ae38-a596593a6b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:17.064215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec89f-c4ce-4387-ae38-a596593a6b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.064680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec89f-c4ce-4387-ae38-a596593a6b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.064997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec89f-c4ce-4387-ae38-a596593a6b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.065694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ec89f-c4ce-4387-ae38-a596593a6b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:17.067329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ec89f-c4ce-4387-ae38-a596593a6b35 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:17.078990 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1060/2108] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:17.083140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e991b0-378b-4c56-a49c-9bc2fd30449a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:17.094562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e991b0-378b-4c56-a49c-9bc2fd30449a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:17.099701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63358d76-070a-4883-8f95-44e2eb1465ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:17.100320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63358d76-070a-4883-8f95-44e2eb1465ae admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.100687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63358d76-070a-4883-8f95-44e2eb1465ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.100859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63358d76-070a-4883-8f95-44e2eb1465ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.101618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63358d76-070a-4883-8f95-44e2eb1465ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:17.103270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63358d76-070a-4883-8f95-44e2eb1465ae admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:17.118444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1049/2109] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:17.119638 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec89f-c4ce-4387-ae38-a596593a6b35 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:17.130507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec89f-c4ce-4387-ae38-a596593a6b35 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:17.135235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e13d7-fa1d-4bc4-9706-2bb8869e8f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:17.139393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e13d7-fa1d-4bc4-9706-2bb8869e8f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.139393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e13d7-fa1d-4bc4-9706-2bb8869e8f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.139393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e13d7-fa1d-4bc4-9706-2bb8869e8f19 admin admin] PATH_INFO: `/v3/projects/64b110e8513d4f9fbc6f503d1b63d06d/users/8fe944f4f8894115b9305bdf7d780749/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.152426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e13d7-fa1d-4bc4-9706-2bb8869e8f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b110e8513d4f9fbc6f503d1b63d06d, user_id=8fe944f4f8894115b9305bdf7d780749, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:17.155471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e13d7-fa1d-4bc4-9706-2bb8869e8f19 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:17.237152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1061/2110] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:17 2022] PUT /identity/v3/projects/64b110e8513d4f9fbc6f503d1b63d06d/users/8fe944f4f8894115b9305bdf7d780749/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:17.247873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b9bc-c351-40a3-b193-916b6f896e7c None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.248159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b9bc-c351-40a3-b193-916b6f896e7c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.248456 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b9bc-c351-40a3-b193-916b6f896e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.279418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-99e1b9bc-c351-40a3-b193-916b6f896e7c None None] MFA Rules not processed for user `8fe944f4f8894115b9305bdf7d780749`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:17.280028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-99e1b9bc-c351-40a3-b193-916b6f896e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:17.353740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1050/2111] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:17.358838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e13d7-fa1d-4bc4-9706-2bb8869e8f19 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:17.423427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e13d7-fa1d-4bc4-9706-2bb8869e8f19 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:17.428344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef82a53-0ab7-4872-9ae7-3e51f8819736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:17.429026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef82a53-0ab7-4872-9ae7-3e51f8819736 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.429312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef82a53-0ab7-4872-9ae7-3e51f8819736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.429582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef82a53-0ab7-4872-9ae7-3e51f8819736 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.430262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef82a53-0ab7-4872-9ae7-3e51f8819736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:17.432177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef82a53-0ab7-4872-9ae7-3e51f8819736 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:17.534299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1062/2112] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:17 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:17.537947 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1b9bc-c351-40a3-b193-916b6f896e7c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:17.550007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1b9bc-c351-40a3-b193-916b6f896e7c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:17.610135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014ac1-c23c-4bd9-adf0-c007bb1f0038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:17.610760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014ac1-c23c-4bd9-adf0-c007bb1f0038 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.611311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014ac1-c23c-4bd9-adf0-c007bb1f0038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.612890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:17.613537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d014ac1-c23c-4bd9-adf0-c007bb1f0038 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.614279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d014ac1-c23c-4bd9-adf0-c007bb1f0038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:17.616510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d014ac1-c23c-4bd9-adf0-c007bb1f0038 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:17.645722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:17.728425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1051/2113] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:17 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:17.730044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef82a53-0ab7-4872-9ae7-3e51f8819736 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:17.741495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef82a53-0ab7-4872-9ae7-3e51f8819736 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:17.746577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8fdb6-20fe-4ffd-81d0-2e302a645f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:17.747306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fdb6-20fe-4ffd-81d0-2e302a645f4d admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.747655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fdb6-20fe-4ffd-81d0-2e302a645f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.748004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fdb6-20fe-4ffd-81d0-2e302a645f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.748827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8fdb6-20fe-4ffd-81d0-2e302a645f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:17.750713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8fdb6-20fe-4ffd-81d0-2e302a645f4d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:17.765325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1063/2114] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:17.769309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014ac1-c23c-4bd9-adf0-c007bb1f0038 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:17.781890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d014ac1-c23c-4bd9-adf0-c007bb1f0038 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:17.787832 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c845-7b48-426b-8624-6d1ce9a4e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:17.789585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c845-7b48-426b-8624-6d1ce9a4e84d admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.789585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c845-7b48-426b-8624-6d1ce9a4e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.789585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c845-7b48-426b-8624-6d1ce9a4e84d admin admin] PATH_INFO: `/v3/projects/6a8252374fe04cb6ac1bdd92f347e11f/users/590f93d5bc8c46db8fcfa9c020a86090/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.806268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008c845-7b48-426b-8624-6d1ce9a4e84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8252374fe04cb6ac1bdd92f347e11f, user_id=590f93d5bc8c46db8fcfa9c020a86090, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:17.811322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008c845-7b48-426b-8624-6d1ce9a4e84d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:17.907862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1052/2115] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:17 2022] PUT /identity/v3/projects/6a8252374fe04cb6ac1bdd92f347e11f/users/590f93d5bc8c46db8fcfa9c020a86090/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:17.914157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8fdb6-20fe-4ffd-81d0-2e302a645f4d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:17.926438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8fdb6-20fe-4ffd-81d0-2e302a645f4d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:17.989420 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0eb5e-5ae4-457f-b0f7-5c52f62cce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:17.996181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0eb5e-5ae4-457f-b0f7-5c52f62cce46 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:17.996181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0eb5e-5ae4-457f-b0f7-5c52f62cce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:17.996181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0eb5e-5ae4-457f-b0f7-5c52f62cce46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:17.996181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0eb5e-5ae4-457f-b0f7-5c52f62cce46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:17.996181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0eb5e-5ae4-457f-b0f7-5c52f62cce46 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:18.008500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1064/2116] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:26:18.013540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c845-7b48-426b-8624-6d1ce9a4e84d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:18.030207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c845-7b48-426b-8624-6d1ce9a4e84d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:18.042029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:18.043308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:18.043592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:18.043973 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] PATH_INFO: `/v3/projects/6a8252374fe04cb6ac1bdd92f347e11f/users/590f93d5bc8c46db8fcfa9c020a86090/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:18.045909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8252374fe04cb6ac1bdd92f347e11f, user_id=590f93d5bc8c46db8fcfa9c020a86090, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:18.049478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:18.066863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1053/2117] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:18 2022] PUT /identity/v3/projects/6a8252374fe04cb6ac1bdd92f347e11f/users/590f93d5bc8c46db8fcfa9c020a86090/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:18.078685 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e09cd-75d0-46a7-91bf-7a8691038ccb None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:18.078986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e09cd-75d0-46a7-91bf-7a8691038ccb None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:18.079268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e09cd-75d0-46a7-91bf-7a8691038ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:18.108273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-688e09cd-75d0-46a7-91bf-7a8691038ccb None None] MFA Rules not processed for user `590f93d5bc8c46db8fcfa9c020a86090`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:18.109554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-688e09cd-75d0-46a7-91bf-7a8691038ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:18.201596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1065/2118] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:18.213890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:18.216455 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:18.279738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4c04-19ac-40ad-8cde-7cc0b1f18abb admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:18.284412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c47b-f731-4986-b6f7-4d24664a1675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:18.285001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c47b-f731-4986-b6f7-4d24664a1675 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:18.285282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c47b-f731-4986-b6f7-4d24664a1675 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:18.285553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c47b-f731-4986-b6f7-4d24664a1675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:18.296717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c47b-f731-4986-b6f7-4d24664a1675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:18.300101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c47b-f731-4986-b6f7-4d24664a1675 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:18.307932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1054/2119] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:18.463984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e09cd-75d0-46a7-91bf-7a8691038ccb None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:18.476094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e09cd-75d0-46a7-91bf-7a8691038ccb None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:18.481401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3648-62b7-4cfa-abff-9671b33ebd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:18.482078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3648-62b7-4cfa-abff-9671b33ebd4b service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:18.482928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3648-62b7-4cfa-abff-9671b33ebd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:18.483258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3648-62b7-4cfa-abff-9671b33ebd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:18.548517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:18.551942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3648-62b7-4cfa-abff-9671b33ebd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:18.555890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3648-62b7-4cfa-abff-9671b33ebd4b service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:18.563033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1066/2120] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:18.708736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:19.818992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:19.990459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:20.771348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:20.859317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:21.370961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:22.877101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c47b-f731-4986-b6f7-4d24664a1675 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:22.943786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c47b-f731-4986-b6f7-4d24664a1675 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:22.953151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:22.953811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:22.954170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:22.954362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] PATH_INFO: `/v3/users/9c9e22f52e86475695f929ec326362de` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:22.955604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9e22f52e86475695f929ec326362de)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:22.957546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:23.107405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9e22f52e86475695f929ec326362de'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:23.107999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9e22f52e86475695f929ec326362de'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:23.108696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9e22f52e86475695f929ec326362de'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:23.121817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9e22f52e86475695f929ec326362de'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:23.205991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9e22f52e86475695f929ec326362de'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:23.254590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1055/2121] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:22 2022] DELETE /identity/v3/users/9c9e22f52e86475695f929ec326362de => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:23.258978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fc4ae-88fb-4e4e-97ae-daeaa41f819e None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:23.259508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fc4ae-88fb-4e4e-97ae-daeaa41f819e None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:23.259653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fc4ae-88fb-4e4e-97ae-daeaa41f819e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:23.305316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-093fc4ae-88fb-4e4e-97ae-daeaa41f819e None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:23.306545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-093fc4ae-88fb-4e4e-97ae-daeaa41f819e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:23.404567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:23.442888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1067/2122] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:23.450617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:23.452514 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:23.505906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:23.521316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e842db-612d-4503-82be-1bef645c8076 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:23.526521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cbab7-163a-4cea-abf5-9307e5eb1696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:23.526521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbab7-163a-4cea-abf5-9307e5eb1696 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:23.526521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbab7-163a-4cea-abf5-9307e5eb1696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:23.526521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbab7-163a-4cea-abf5-9307e5eb1696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:23.535633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cbab7-163a-4cea-abf5-9307e5eb1696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:23.537091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cbab7-163a-4cea-abf5-9307e5eb1696 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:23.547915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1056/2123] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:24.078200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fc4ae-88fb-4e4e-97ae-daeaa41f819e None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:24.079639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-093fc4ae-88fb-4e4e-97ae-daeaa41f819e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:24.099562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fc4ae-88fb-4e4e-97ae-daeaa41f819e None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:24.109757 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:24.110457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:24.110761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:24.111035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] PATH_INFO: `/v3/projects/ce48d244360b4221896ad6d75fe2ebdc` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:24.112355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce48d244360b4221896ad6d75fe2ebdc)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:24.114454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:24.254194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce48d244360b4221896ad6d75fe2ebdc', 'request_id': 'req-e3d12747-3b44-4335-8b00-d792ac484afd'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.261141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce48d244360b4221896ad6d75fe2ebdc', 'request_id': 'req-e3d12747-3b44-4335-8b00-d792ac484afd'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.373826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce48d244360b4221896ad6d75fe2ebdc', 'request_id': 'req-e3d12747-3b44-4335-8b00-d792ac484afd'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.386900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] The token cache is being invalidate because project ce48d244360b4221896ad6d75fe2ebdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:24.387588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.388419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.391518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1068/2124] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:24 2022] DELETE /identity/v3/projects/ce48d244360b4221896ad6d75fe2ebdc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:24.395642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cbab7-163a-4cea-abf5-9307e5eb1696 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:24.407513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cbab7-163a-4cea-abf5-9307e5eb1696 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:24.490702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:24.491530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:24.492373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:24.492373 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] PATH_INFO: `/v3/users/8fe944f4f8894115b9305bdf7d780749` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:24.493407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe944f4f8894115b9305bdf7d780749)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:24.495594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:24.686765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe944f4f8894115b9305bdf7d780749'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.687350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe944f4f8894115b9305bdf7d780749'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.687957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe944f4f8894115b9305bdf7d780749'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.700589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe944f4f8894115b9305bdf7d780749'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.771411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe944f4f8894115b9305bdf7d780749'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:24.786115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1057/2125] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:24 2022] DELETE /identity/v3/users/8fe944f4f8894115b9305bdf7d780749 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:25.269621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:25.271237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:25.302816 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12747-3b44-4335-8b00-d792ac484afd admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:25.398282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:25.399246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:25.399534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:25.399811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] PATH_INFO: `/v3/projects/64b110e8513d4f9fbc6f503d1b63d06d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:25.401196 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b110e8513d4f9fbc6f503d1b63d06d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:25.403401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:25.527966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b110e8513d4f9fbc6f503d1b63d06d', 'request_id': 'req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:25.533541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b110e8513d4f9fbc6f503d1b63d06d', 'request_id': 'req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:25.600439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b110e8513d4f9fbc6f503d1b63d06d', 'request_id': 'req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:25.611872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:25.618582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] The token cache is being invalidate because project 64b110e8513d4f9fbc6f503d1b63d06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:25.618949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:25.619750 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:25.621628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1069/2126] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:25 2022] DELETE /identity/v3/projects/64b110e8513d4f9fbc6f503d1b63d06d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:25.626459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:25.627345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:25.690471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e8e9-413c-4bc9-a807-c6b410d4e915 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:25.748697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:25.749517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:25.749873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:25.750265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] PATH_INFO: `/v3/users/590f93d5bc8c46db8fcfa9c020a86090` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:25.751702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=590f93d5bc8c46db8fcfa9c020a86090)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:25.753839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:25.755744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:25.951885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590f93d5bc8c46db8fcfa9c020a86090'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:25.952498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590f93d5bc8c46db8fcfa9c020a86090'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:25.953231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590f93d5bc8c46db8fcfa9c020a86090'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:25.966555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590f93d5bc8c46db8fcfa9c020a86090'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:26.028953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1395c615-e5b4-41dd-b814-febdea500bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590f93d5bc8c46db8fcfa9c020a86090'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:26.044007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1058/2127] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:25 2022] DELETE /identity/v3/users/590f93d5bc8c46db8fcfa9c020a86090 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:26.516054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:26.517857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:26.537218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbed09-b846-47d1-8b6a-5b9735d7ea57 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:26.603891 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:26.604645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:26.605028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:26.605376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] PATH_INFO: `/v3/projects/6a8252374fe04cb6ac1bdd92f347e11f` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:26.606808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8252374fe04cb6ac1bdd92f347e11f)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:26.608819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:26.736702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8252374fe04cb6ac1bdd92f347e11f', 'request_id': 'req-de580c08-ead3-4e1d-be1c-d398ca469de9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:26.744468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8252374fe04cb6ac1bdd92f347e11f', 'request_id': 'req-de580c08-ead3-4e1d-be1c-d398ca469de9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:26.811340 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8252374fe04cb6ac1bdd92f347e11f', 'request_id': 'req-de580c08-ead3-4e1d-be1c-d398ca469de9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:26.827485 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] The token cache is being invalidate because project 6a8252374fe04cb6ac1bdd92f347e11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:26.827808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:26.828531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-de580c08-ead3-4e1d-be1c-d398ca469de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:26.830110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1070/2128] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:26 2022] DELETE /identity/v3/projects/6a8252374fe04cb6ac1bdd92f347e11f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:26.837478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9fdc2-9b51-4e9f-a48c-85ec5920f28b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:26.838339 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9fdc2-9b51-4e9f-a48c-85ec5920f28b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:26.838612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9fdc2-9b51-4e9f-a48c-85ec5920f28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:26.861118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-37e9fdc2-9b51-4e9f-a48c-85ec5920f28b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:26.862799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-37e9fdc2-9b51-4e9f-a48c-85ec5920f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:26.929740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1059/2129] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:26.940186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f607a6-354e-43b4-8d62-a66a4b4a4d16 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:26.940474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f607a6-354e-43b4-8d62-a66a4b4a4d16 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:26.940746 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f607a6-354e-43b4-8d62-a66a4b4a4d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:26.963684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-34f607a6-354e-43b4-8d62-a66a4b4a4d16 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:26.965092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-34f607a6-354e-43b4-8d62-a66a4b4a4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:26.976834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1071/2130] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:26.991576 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9fdc2-9b51-4e9f-a48c-85ec5920f28b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:26.992045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9fdc2-9b51-4e9f-a48c-85ec5920f28b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:26.997377 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:26.998332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:26.998453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:26.998806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:26.999566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:26:26.999937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:27.001872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:27.019093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1060/2131] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:26:27.020069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f607a6-354e-43b4-8d62-a66a4b4a4d16 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:27.030888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f607a6-354e-43b4-8d62-a66a4b4a4d16 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:27.035672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb9f7f-717f-4679-94be-c9b5ef182660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:27.036283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9f7f-717f-4679-94be-c9b5ef182660 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:27.036565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9f7f-717f-4679-94be-c9b5ef182660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:27.036840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9f7f-717f-4679-94be-c9b5ef182660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:27.037546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb9f7f-717f-4679-94be-c9b5ef182660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:27.039474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb9f7f-717f-4679-94be-c9b5ef182660 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:27.153586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1072/2132] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:27 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:26:27.157297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:27.167488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1a613-fdb5-4348-8cba-64c8fc735cc8 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:27.233271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762a30-9716-4552-a10a-dfa60e2a4af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:27.233891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762a30-9716-4552-a10a-dfa60e2a4af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:27.234168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762a30-9716-4552-a10a-dfa60e2a4af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:27.234463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762a30-9716-4552-a10a-dfa60e2a4af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:27.235095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed762a30-9716-4552-a10a-dfa60e2a4af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:27.237015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed762a30-9716-4552-a10a-dfa60e2a4af3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:27.248549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:27.367131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1061/2133] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:27 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:26:27.368222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb9f7f-717f-4679-94be-c9b5ef182660 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:27.380823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb9f7f-717f-4679-94be-c9b5ef182660 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:27.385649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13146bd-2cb3-4e8d-a0ba-fb4e068cfa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:27.386411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13146bd-2cb3-4e8d-a0ba-fb4e068cfa0f admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:27.386691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13146bd-2cb3-4e8d-a0ba-fb4e068cfa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:27.387719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13146bd-2cb3-4e8d-a0ba-fb4e068cfa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:27.388423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13146bd-2cb3-4e8d-a0ba-fb4e068cfa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:27.390134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13146bd-2cb3-4e8d-a0ba-fb4e068cfa0f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:27.401469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1073/2134] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:26:27.406352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762a30-9716-4552-a10a-dfa60e2a4af3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:27.416466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762a30-9716-4552-a10a-dfa60e2a4af3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:27.424554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a2e7f-f803-42ef-b807-f65efa6d46f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:27.424554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a2e7f-f803-42ef-b807-f65efa6d46f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:27.424554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a2e7f-f803-42ef-b807-f65efa6d46f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:27.424554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a2e7f-f803-42ef-b807-f65efa6d46f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:27.427282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a2e7f-f803-42ef-b807-f65efa6d46f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:27.432066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a2e7f-f803-42ef-b807-f65efa6d46f0 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:27.456911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1062/2135] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:27.463688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13146bd-2cb3-4e8d-a0ba-fb4e068cfa0f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:27.491491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13146bd-2cb3-4e8d-a0ba-fb4e068cfa0f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:27.508042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:27.508605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:27.508914 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:27.509240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] PATH_INFO: `/v3/projects/891401e5e08546cfab5a929ef579904e/users/285f682c55894bf2b359ab4fa445e58e/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:27.529068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891401e5e08546cfab5a929ef579904e, user_id=285f682c55894bf2b359ab4fa445e58e, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:27.543451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:27.643279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1074/2136] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:27 2022] PUT /identity/v3/projects/891401e5e08546cfab5a929ef579904e/users/285f682c55894bf2b359ab4fa445e58e/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:27.652737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcda1b-96c2-4084-b845-e1691c644fb8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:27.653953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcda1b-96c2-4084-b845-e1691c644fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:27.654328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcda1b-96c2-4084-b845-e1691c644fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:27.694420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9dbcda1b-96c2-4084-b845-e1691c644fb8 None None] MFA Rules not processed for user `285f682c55894bf2b359ab4fa445e58e`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:27.695698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9dbcda1b-96c2-4084-b845-e1691c644fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:27.773858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1063/2137] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:26:27.786211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:27.788292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:27.825675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:27.862255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2e934-9af6-4f7a-a442-c70590015382 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:27.866824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea030fa-f46e-4f03-a9cc-c6d6495be601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:27.867006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea030fa-f46e-4f03-a9cc-c6d6495be601 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:27.867215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea030fa-f46e-4f03-a9cc-c6d6495be601 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:27.867543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea030fa-f46e-4f03-a9cc-c6d6495be601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:27.885913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea030fa-f46e-4f03-a9cc-c6d6495be601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:27.887429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea030fa-f46e-4f03-a9cc-c6d6495be601 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:27.899737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1075/2138] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:31.957216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcda1b-96c2-4084-b845-e1691c644fb8 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:31.959526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9dbcda1b-96c2-4084-b845-e1691c644fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:32.024779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcda1b-96c2-4084-b845-e1691c644fb8 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:32.029432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:32.033607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:32.033607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:32.033607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] PATH_INFO: `/v3/users/7f704365cd13447bb52a8f21365def41` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:32.033607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f704365cd13447bb52a8f21365def41)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:32.033965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:32.272958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f704365cd13447bb52a8f21365def41'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:32.274117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f704365cd13447bb52a8f21365def41'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:32.274836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f704365cd13447bb52a8f21365def41'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:32.291008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f704365cd13447bb52a8f21365def41'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:32.365197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f704365cd13447bb52a8f21365def41'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:32.370451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:32.381873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1064/2139] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:31 2022] DELETE /identity/v3/users/7f704365cd13447bb52a8f21365def41 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:32.386026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a11-b3d6-4f23-9c81-73b5f8198243 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:32.386591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a11-b3d6-4f23-9c81-73b5f8198243 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:32.386812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a11-b3d6-4f23-9c81-73b5f8198243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:32.407169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-962d2a11-b3d6-4f23-9c81-73b5f8198243 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:32.408398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-962d2a11-b3d6-4f23-9c81-73b5f8198243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:32.523678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1076/2140] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:32.533449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:32.535039 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:32.600271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429c07c-b3cc-4390-9bb0-fbe3548f3fcb admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:32.603892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:32.604507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:32.604780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:32.605078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:32.615684 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:32.620829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:32.628010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1065/2141] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:32.656366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84df158-212b-47c4-acc8-b91d64d67747 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:32.656776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84df158-212b-47c4-acc8-b91d64d67747 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:32.657090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84df158-212b-47c4-acc8-b91d64d67747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:32.694162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-a84df158-212b-47c4-acc8-b91d64d67747 None None] MFA Rules not processed for user `793d3d46e32b4550b711841f2447461a`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:32.700460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a84df158-212b-47c4-acc8-b91d64d67747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:32.791655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1077/2142] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:33.271750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:33.275180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:33.295102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933ace5-b4b9-4f53-a3b6-1c4514a4f26b service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:33.318628 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:33.319343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:33.319625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:33.320254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] PATH_INFO: `/v3/projects/870df42f2e884ae39ca1391205ece401` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:33.321654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] RBAC: Authorizing `identity:delete_project(project_id=870df42f2e884ae39ca1391205ece401)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:33.326135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:33.498735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870df42f2e884ae39ca1391205ece401', 'request_id': 'req-d83d0e50-19af-4b33-baa5-ca894147471e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:33.507487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870df42f2e884ae39ca1391205ece401', 'request_id': 'req-d83d0e50-19af-4b33-baa5-ca894147471e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:33.640657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870df42f2e884ae39ca1391205ece401', 'request_id': 'req-d83d0e50-19af-4b33-baa5-ca894147471e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:33.653347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] The token cache is being invalidate because project 870df42f2e884ae39ca1391205ece401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:33.653635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:33.654293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d83d0e50-19af-4b33-baa5-ca894147471e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:33.655887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1066/2143] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:33 2022] DELETE /identity/v3/projects/870df42f2e884ae39ca1391205ece401 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:33.660867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237475e9-a2d4-4716-a1db-59f5c65c8732 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:33.661734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237475e9-a2d4-4716-a1db-59f5c65c8732 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:33.661996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237475e9-a2d4-4716-a1db-59f5c65c8732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:33.682292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-237475e9-a2d4-4716-a1db-59f5c65c8732 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:33.683494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-237475e9-a2d4-4716-a1db-59f5c65c8732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:33.747210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1078/2144] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:33.756127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340847-05f3-4192-a0c9-5c008adc23a5 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:33.756555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340847-05f3-4192-a0c9-5c008adc23a5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:33.756837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340847-05f3-4192-a0c9-5c008adc23a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:33.786543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6d340847-05f3-4192-a0c9-5c008adc23a5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:33.787931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6d340847-05f3-4192-a0c9-5c008adc23a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:33.798060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1067/2145] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:33.802633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237475e9-a2d4-4716-a1db-59f5c65c8732 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:33.814081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237475e9-a2d4-4716-a1db-59f5c65c8732 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:33.819822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:33.820560 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:33.820923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:33.821305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:33.822156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:26:33.822586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:33.824161 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:33.835112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:33.840399 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1079/2146] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:26:33.844654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340847-05f3-4192-a0c9-5c008adc23a5 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:33.855570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340847-05f3-4192-a0c9-5c008adc23a5 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:33.861680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdce46-d2d8-4c29-8707-3ba7a54e9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:33.862424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdce46-d2d8-4c29-8707-3ba7a54e9ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:33.862837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdce46-d2d8-4c29-8707-3ba7a54e9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:33.863204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdce46-d2d8-4c29-8707-3ba7a54e9ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:33.863971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdce46-d2d8-4c29-8707-3ba7a54e9ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:33.866030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdce46-d2d8-4c29-8707-3ba7a54e9ffd admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:33.976921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1068/2147] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:33 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:33.979562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:33.990341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e239d2a-81bf-4d11-a372-54edcc0a4d57 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:34.060911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb215-ce63-4d10-a563-f11c48a736dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:34.061979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb215-ce63-4d10-a563-f11c48a736dd admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:34.062257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb215-ce63-4d10-a563-f11c48a736dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:34.062855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb215-ce63-4d10-a563-f11c48a736dd admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:34.063726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb215-ce63-4d10-a563-f11c48a736dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:34.065689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb215-ce63-4d10-a563-f11c48a736dd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:34.159137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1080/2148] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:33 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:34.160177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdce46-d2d8-4c29-8707-3ba7a54e9ffd admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:34.171601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdce46-d2d8-4c29-8707-3ba7a54e9ffd admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:34.176785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7c37b-104c-419a-81fe-696c7c5a4e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:34.177414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7c37b-104c-419a-81fe-696c7c5a4e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:34.177693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7c37b-104c-419a-81fe-696c7c5a4e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:34.182160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7c37b-104c-419a-81fe-696c7c5a4e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:34.182160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7c37b-104c-419a-81fe-696c7c5a4e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:34.182160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7c37b-104c-419a-81fe-696c7c5a4e08 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:34.192330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1069/2149] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:26:34.196720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb215-ce63-4d10-a563-f11c48a736dd admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:34.208916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb215-ce63-4d10-a563-f11c48a736dd admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:34.213856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1123f8-e58c-448a-8875-7c3b23cfd82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:34.214503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1123f8-e58c-448a-8875-7c3b23cfd82c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:34.214786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1123f8-e58c-448a-8875-7c3b23cfd82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:34.215059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1123f8-e58c-448a-8875-7c3b23cfd82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:34.215761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1123f8-e58c-448a-8875-7c3b23cfd82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:34.217500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1123f8-e58c-448a-8875-7c3b23cfd82c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:34.230023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1081/2150] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:34.234251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7c37b-104c-419a-81fe-696c7c5a4e08 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:34.244985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7c37b-104c-419a-81fe-696c7c5a4e08 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:34.251000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:34.251738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:34.252067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:34.252346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] PATH_INFO: `/v3/projects/974433129936489cb7e7a227f58c3dde/users/42dbc285e967443589e9543992086b87/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:34.269789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] RBAC: Authorizing `identity:create_grant(project_id=974433129936489cb7e7a227f58c3dde, user_id=42dbc285e967443589e9543992086b87, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:34.272713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:34.346560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1070/2151] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:34 2022] PUT /identity/v3/projects/974433129936489cb7e7a227f58c3dde/users/42dbc285e967443589e9543992086b87/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:34.358056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d69e65-973c-4d4e-9d76-d9f22f516d26 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:34.358384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d69e65-973c-4d4e-9d76-d9f22f516d26 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:34.359336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d69e65-973c-4d4e-9d76-d9f22f516d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:34.400834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-a8d69e65-973c-4d4e-9d76-d9f22f516d26 None None] MFA Rules not processed for user `42dbc285e967443589e9543992086b87`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:34.400834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a8d69e65-973c-4d4e-9d76-d9f22f516d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:34.463151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1082/2152] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:34.478866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:34.480762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:34.510662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:34.554479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa64a6-7180-42e9-acd5-a138268ffada admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:34.559425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44070c4-9396-4d7c-b7ff-216f897be387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:34.560915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44070c4-9396-4d7c-b7ff-216f897be387 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:34.561865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44070c4-9396-4d7c-b7ff-216f897be387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:34.561865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44070c4-9396-4d7c-b7ff-216f897be387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:34.572003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44070c4-9396-4d7c-b7ff-216f897be387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:34.573741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44070c4-9396-4d7c-b7ff-216f897be387 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:34.603876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1071/2153] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:35.445436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d69e65-973c-4d4e-9d76-d9f22f516d26 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:35.447797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a8d69e65-973c-4d4e-9d76-d9f22f516d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:35.551873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d69e65-973c-4d4e-9d76-d9f22f516d26 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:35.556549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:35.557162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:35.557447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:35.557718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] PATH_INFO: `/v3/users/285f682c55894bf2b359ab4fa445e58e` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:35.559094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285f682c55894bf2b359ab4fa445e58e)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:35.561473 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:35.575347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:35.826606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285f682c55894bf2b359ab4fa445e58e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:35.833309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285f682c55894bf2b359ab4fa445e58e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:35.915823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285f682c55894bf2b359ab4fa445e58e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:35.928853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285f682c55894bf2b359ab4fa445e58e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:35.929581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285f682c55894bf2b359ab4fa445e58e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:35.935987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1083/2154] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:35 2022] DELETE /identity/v3/users/285f682c55894bf2b359ab4fa445e58e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:35.940517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805ba1-f2fa-451c-99d9-780ce7c77546 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:35.941035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805ba1-f2fa-451c-99d9-780ce7c77546 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:35.941243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805ba1-f2fa-451c-99d9-780ce7c77546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:35.960614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a4805ba1-f2fa-451c-99d9-780ce7c77546 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:35.961845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a4805ba1-f2fa-451c-99d9-780ce7c77546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:36.036136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1072/2155] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:36.047714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:36.049239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:36.130865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c990e-58ec-4b13-af39-1361e1fb1a82 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:36.139388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b92a3d-2df9-4dba-8960-7dd4f2b78951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:36.139388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b92a3d-2df9-4dba-8960-7dd4f2b78951 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:36.139596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b92a3d-2df9-4dba-8960-7dd4f2b78951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:36.140294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b92a3d-2df9-4dba-8960-7dd4f2b78951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:36.167972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b92a3d-2df9-4dba-8960-7dd4f2b78951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:36.170014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b92a3d-2df9-4dba-8960-7dd4f2b78951 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:36.182153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1084/2156] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:36.644651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805ba1-f2fa-451c-99d9-780ce7c77546 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:36.646105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a4805ba1-f2fa-451c-99d9-780ce7c77546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:36.660694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805ba1-f2fa-451c-99d9-780ce7c77546 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:36.665754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:36.666509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:36.669060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:36.669060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] PATH_INFO: `/v3/projects/891401e5e08546cfab5a929ef579904e` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:36.669060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891401e5e08546cfab5a929ef579904e)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:36.672500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:36.820732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891401e5e08546cfab5a929ef579904e', 'request_id': 'req-3432501a-84b6-436d-a6de-6c1ef53dfdc9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:36.826493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891401e5e08546cfab5a929ef579904e', 'request_id': 'req-3432501a-84b6-436d-a6de-6c1ef53dfdc9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:36.957871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891401e5e08546cfab5a929ef579904e', 'request_id': 'req-3432501a-84b6-436d-a6de-6c1ef53dfdc9'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:36.971306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] The token cache is being invalidate because project 891401e5e08546cfab5a929ef579904e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:36.971545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:36.972193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3432501a-84b6-436d-a6de-6c1ef53dfdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:36.973772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1073/2157] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:36 2022] DELETE /identity/v3/projects/891401e5e08546cfab5a929ef579904e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:36.979195 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f029e-661a-43d3-babe-d2a155053bdf None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:36.979664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f029e-661a-43d3-babe-d2a155053bdf None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:36.980002 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f029e-661a-43d3-babe-d2a155053bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.005210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d27f029e-661a-43d3-babe-d2a155053bdf None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:37.006417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d27f029e-661a-43d3-babe-d2a155053bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:37.076538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1085/2158] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:37.084671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165dec9-c98a-4419-8869-a7b9a9d893eb None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.084985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165dec9-c98a-4419-8869-a7b9a9d893eb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.085261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165dec9-c98a-4419-8869-a7b9a9d893eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.105896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0165dec9-c98a-4419-8869-a7b9a9d893eb None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:37.107763 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0165dec9-c98a-4419-8869-a7b9a9d893eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:37.115841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1074/2159] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:37.120019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f029e-661a-43d3-babe-d2a155053bdf None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:37.130902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f029e-661a-43d3-babe-d2a155053bdf None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:37.135840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:37.136440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.136722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.137044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.137708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:26:37.138120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:37.139923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:37.154247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1086/2160] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:26:37.158470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165dec9-c98a-4419-8869-a7b9a9d893eb None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:37.168459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165dec9-c98a-4419-8869-a7b9a9d893eb None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:37.173845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f41192-4905-4b43-9541-39d2457dae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:37.174458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f41192-4905-4b43-9541-39d2457dae87 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.174730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f41192-4905-4b43-9541-39d2457dae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.174993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f41192-4905-4b43-9541-39d2457dae87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.175641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f41192-4905-4b43-9541-39d2457dae87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:37.177609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f41192-4905-4b43-9541-39d2457dae87 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:37.269263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1075/2161] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:37 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:37.277131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:37.290294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac4150-8e2a-46b8-ab24-99fecc7e33c4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:37.309423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:37.354735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed20fcf-a05a-4a2c-8462-cd1edb6c97a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:37.355549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed20fcf-a05a-4a2c-8462-cd1edb6c97a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.356014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed20fcf-a05a-4a2c-8462-cd1edb6c97a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.357607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed20fcf-a05a-4a2c-8462-cd1edb6c97a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.358694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed20fcf-a05a-4a2c-8462-cd1edb6c97a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:37.360829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed20fcf-a05a-4a2c-8462-cd1edb6c97a0 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:37.476387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1087/2162] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:37 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:37.477792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f41192-4905-4b43-9541-39d2457dae87 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:37.489541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f41192-4905-4b43-9541-39d2457dae87 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:37.497109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d623d-ee9c-402b-a388-5608263804ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:37.498907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d623d-ee9c-402b-a388-5608263804ee admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.499182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d623d-ee9c-402b-a388-5608263804ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.499687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d623d-ee9c-402b-a388-5608263804ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.500603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d623d-ee9c-402b-a388-5608263804ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:37.506505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d623d-ee9c-402b-a388-5608263804ee admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:37.519048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1076/2163] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:37.523443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed20fcf-a05a-4a2c-8462-cd1edb6c97a0 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:37.535856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed20fcf-a05a-4a2c-8462-cd1edb6c97a0 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:37.541568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ee93d-01fa-4b5c-aa9b-76e6a0d534e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:37.542543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee93d-01fa-4b5c-aa9b-76e6a0d534e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.543915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee93d-01fa-4b5c-aa9b-76e6a0d534e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.544639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee93d-01fa-4b5c-aa9b-76e6a0d534e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.545610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ee93d-01fa-4b5c-aa9b-76e6a0d534e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:37.548133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ee93d-01fa-4b5c-aa9b-76e6a0d534e4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:37.565204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1088/2164] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:26:37.569530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d623d-ee9c-402b-a388-5608263804ee admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:37.577362 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:37.584559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d623d-ee9c-402b-a388-5608263804ee admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:37.598811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01853bd5-c26a-4e6f-85a0-0c05f701d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:37.599797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853bd5-c26a-4e6f-85a0-0c05f701d833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.600196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853bd5-c26a-4e6f-85a0-0c05f701d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.600527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853bd5-c26a-4e6f-85a0-0c05f701d833 admin admin] PATH_INFO: `/v3/projects/b4db4c86e7c54c60bbf12b1b1b70023b/users/d0aaa9a5b9ae4326bdcbf35eabd34649/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.624477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01853bd5-c26a-4e6f-85a0-0c05f701d833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4db4c86e7c54c60bbf12b1b1b70023b, user_id=d0aaa9a5b9ae4326bdcbf35eabd34649, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:37.627612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01853bd5-c26a-4e6f-85a0-0c05f701d833 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:37.736417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1077/2165] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:37 2022] PUT /identity/v3/projects/b4db4c86e7c54c60bbf12b1b1b70023b/users/d0aaa9a5b9ae4326bdcbf35eabd34649/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:37.747635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c810-5ce0-4058-b2a2-716857ac78ad None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.747635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c810-5ce0-4058-b2a2-716857ac78ad None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.752407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c810-5ce0-4058-b2a2-716857ac78ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.794270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f791c810-5ce0-4058-b2a2-716857ac78ad None None] MFA Rules not processed for user `d0aaa9a5b9ae4326bdcbf35eabd34649`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:37.795997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f791c810-5ce0-4058-b2a2-716857ac78ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:37.907578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1089/2166] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:37.912835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01853bd5-c26a-4e6f-85a0-0c05f701d833 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:37.986843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01853bd5-c26a-4e6f-85a0-0c05f701d833 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:37.992333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532e0ca-c094-4910-8fff-4521f5d8df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:37.993079 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532e0ca-c094-4910-8fff-4521f5d8df3b admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:37.993425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532e0ca-c094-4910-8fff-4521f5d8df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:37.993782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532e0ca-c094-4910-8fff-4521f5d8df3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:37.994695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532e0ca-c094-4910-8fff-4521f5d8df3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:37.996710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532e0ca-c094-4910-8fff-4521f5d8df3b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:38.085742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1078/2167] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:37 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:38.090605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c810-5ce0-4058-b2a2-716857ac78ad None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:38.104437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c810-5ce0-4058-b2a2-716857ac78ad None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:38.164954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a2f8d-5811-4735-afe9-f4bea50a07b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:38.165514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a2f8d-5811-4735-afe9-f4bea50a07b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:38.165828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a2f8d-5811-4735-afe9-f4bea50a07b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:38.166105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a2f8d-5811-4735-afe9-f4bea50a07b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:38.166773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a2f8d-5811-4735-afe9-f4bea50a07b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:38.168736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a2f8d-5811-4735-afe9-f4bea50a07b1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:38.286776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1090/2168] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:38 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:38.290379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532e0ca-c094-4910-8fff-4521f5d8df3b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:38.326098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532e0ca-c094-4910-8fff-4521f5d8df3b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:38.331876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9952f-7636-41c5-afb0-edb43271e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:38.332857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9952f-7636-41c5-afb0-edb43271e4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:38.333446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9952f-7636-41c5-afb0-edb43271e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:38.333945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9952f-7636-41c5-afb0-edb43271e4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:38.335308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9952f-7636-41c5-afb0-edb43271e4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:38.337398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9952f-7636-41c5-afb0-edb43271e4e2 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:38.350852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1079/2169] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:38.355136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a2f8d-5811-4735-afe9-f4bea50a07b1 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:38.369934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a2f8d-5811-4735-afe9-f4bea50a07b1 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:38.406262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a92d-c4eb-445c-a16e-1aa664e2c206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:38.407046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a92d-c4eb-445c-a16e-1aa664e2c206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:38.407783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a92d-c4eb-445c-a16e-1aa664e2c206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:38.408169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a92d-c4eb-445c-a16e-1aa664e2c206 admin admin] PATH_INFO: `/v3/projects/5994b1c96bad4415b312c7242538f183/users/1ae82d249d764e64bb19778f6141be6c/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:38.458460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:38.462953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4a92d-c4eb-445c-a16e-1aa664e2c206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5994b1c96bad4415b312c7242538f183, user_id=1ae82d249d764e64bb19778f6141be6c, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:38.467166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4a92d-c4eb-445c-a16e-1aa664e2c206 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:38.548667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1091/2170] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:38 2022] PUT /identity/v3/projects/5994b1c96bad4415b312c7242538f183/users/1ae82d249d764e64bb19778f6141be6c/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:38.552188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9952f-7636-41c5-afb0-edb43271e4e2 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:38.563556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9952f-7636-41c5-afb0-edb43271e4e2 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:38.626847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b602fe-bac5-41c8-95d3-57a8063fd54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:38.627473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b602fe-bac5-41c8-95d3-57a8063fd54b admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:38.627750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b602fe-bac5-41c8-95d3-57a8063fd54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:38.628029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b602fe-bac5-41c8-95d3-57a8063fd54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:38.628729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b602fe-bac5-41c8-95d3-57a8063fd54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:38.630404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b602fe-bac5-41c8-95d3-57a8063fd54b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:38.644524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1080/2171] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:38.649209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a92d-c4eb-445c-a16e-1aa664e2c206 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:38.660406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a92d-c4eb-445c-a16e-1aa664e2c206 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:38.665805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:38.666707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:38.667186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:38.667385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] PATH_INFO: `/v3/projects/5994b1c96bad4415b312c7242538f183/users/1ae82d249d764e64bb19778f6141be6c/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:38.669577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5994b1c96bad4415b312c7242538f183, user_id=1ae82d249d764e64bb19778f6141be6c, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:38.685903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:38.701137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1092/2172] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:38 2022] PUT /identity/v3/projects/5994b1c96bad4415b312c7242538f183/users/1ae82d249d764e64bb19778f6141be6c/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:38.711338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74aae-60b0-4263-8c18-97bcc215a200 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:38.711629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74aae-60b0-4263-8c18-97bcc215a200 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:38.711903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74aae-60b0-4263-8c18-97bcc215a200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:38.745007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2ab74aae-60b0-4263-8c18-97bcc215a200 None None] MFA Rules not processed for user `1ae82d249d764e64bb19778f6141be6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:38.746229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2ab74aae-60b0-4263-8c18-97bcc215a200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:38.791156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:38.825912 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1081/2173] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:38.839022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:38.841689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:38.902998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca24dd-9166-4e97-a0a7-48143614f492 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:38.908906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f8416-c81e-4028-a9cc-ef7a4a8921aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:38.909546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f8416-c81e-4028-a9cc-ef7a4a8921aa service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:38.909833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f8416-c81e-4028-a9cc-ef7a4a8921aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:38.910137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f8416-c81e-4028-a9cc-ef7a4a8921aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:38.993763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f8416-c81e-4028-a9cc-ef7a4a8921aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:38.999590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f8416-c81e-4028-a9cc-ef7a4a8921aa service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:39.010515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1093/2174] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:39.382738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab74aae-60b0-4263-8c18-97bcc215a200 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:39.384557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2ab74aae-60b0-4263-8c18-97bcc215a200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:39.432909 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51b5b-cbf1-46a4-9691-a38bae69e915 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:39.433727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51b5b-cbf1-46a4-9691-a38bae69e915 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:39.434146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51b5b-cbf1-46a4-9691-a38bae69e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:39.476947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-83d51b5b-cbf1-46a4-9691-a38bae69e915 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:39.478777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-83d51b5b-cbf1-46a4-9691-a38bae69e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:39.519312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab74aae-60b0-4263-8c18-97bcc215a200 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:39.522841 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:39.523610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:39.528108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:39.529313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] PATH_INFO: `/v3/users/42dbc285e967443589e9543992086b87` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:39.531462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dbc285e967443589e9543992086b87)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:39.533726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:39.559403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1094/2175] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:26:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:26:39.614045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51b5b-cbf1-46a4-9691-a38bae69e915 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:39.615639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-83d51b5b-cbf1-46a4-9691-a38bae69e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:39.680259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:39.719303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51b5b-cbf1-46a4-9691-a38bae69e915 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:39.727588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fc6a9-b1b4-4cca-ac59-dfcc15584b05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:39.728582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fc6a9-b1b4-4cca-ac59-dfcc15584b05 service swift] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:39.729272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fc6a9-b1b4-4cca-ac59-dfcc15584b05 service swift] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:39.729854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fc6a9-b1b4-4cca-ac59-dfcc15584b05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:39.749218 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fc6a9-b1b4-4cca-ac59-dfcc15584b05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:39.751440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fc6a9-b1b4-4cca-ac59-dfcc15584b05 service swift] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:39.783815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1095/2176] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:26:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:26:39.887620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dbc285e967443589e9543992086b87'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:39.892940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dbc285e967443589e9543992086b87'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:39.892940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dbc285e967443589e9543992086b87'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:39.947860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dbc285e967443589e9543992086b87'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:40.051995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dbc285e967443589e9543992086b87'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:40.079037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1082/2177] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:39 2022] DELETE /identity/v3/users/42dbc285e967443589e9543992086b87 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:40.084133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369dcc-a23f-4a2b-b400-5fc4b5bba454 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:40.084656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369dcc-a23f-4a2b-b400-5fc4b5bba454 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:40.085718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369dcc-a23f-4a2b-b400-5fc4b5bba454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:40.129081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-94369dcc-a23f-4a2b-b400-5fc4b5bba454 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:40.131600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-94369dcc-a23f-4a2b-b400-5fc4b5bba454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:40.241282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1096/2178] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:40.259354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:40.261666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:40.376560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244dedd-66b7-42ef-8c62-c7c8865d50a5 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:40.384047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4f12c-5662-487e-bc4e-88553c0034a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:40.384804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f12c-5662-487e-bc4e-88553c0034a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:40.384951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f12c-5662-487e-bc4e-88553c0034a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:40.387691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f12c-5662-487e-bc4e-88553c0034a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:40.398878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:40.402269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4f12c-5662-487e-bc4e-88553c0034a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:40.404964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4f12c-5662-487e-bc4e-88553c0034a6 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:40.426046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1083/2179] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:26:41.625241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94369dcc-a23f-4a2b-b400-5fc4b5bba454 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:41.626946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-94369dcc-a23f-4a2b-b400-5fc4b5bba454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:41.695624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94369dcc-a23f-4a2b-b400-5fc4b5bba454 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:41.712436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:41.714641 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:41.714942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:41.718924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] PATH_INFO: `/v3/projects/974433129936489cb7e7a227f58c3dde` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:41.720909 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=974433129936489cb7e7a227f58c3dde)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:41.726357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:41.955342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974433129936489cb7e7a227f58c3dde', 'request_id': 'req-353dba38-325c-41d4-bd63-343c302a2cc7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:41.978484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974433129936489cb7e7a227f58c3dde', 'request_id': 'req-353dba38-325c-41d4-bd63-343c302a2cc7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:42.070349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974433129936489cb7e7a227f58c3dde', 'request_id': 'req-353dba38-325c-41d4-bd63-343c302a2cc7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:42.105998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] The token cache is being invalidate because project 974433129936489cb7e7a227f58c3dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:42.106759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:42.109954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-353dba38-325c-41d4-bd63-343c302a2cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:42.119610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1097/2180] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:41 2022] DELETE /identity/v3/projects/974433129936489cb7e7a227f58c3dde => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:42.123643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6fa2-7f8d-47bd-9931-9056cae415b0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:42.125517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6fa2-7f8d-47bd-9931-9056cae415b0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:42.125881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6fa2-7f8d-47bd-9931-9056cae415b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:42.160299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-443f6fa2-7f8d-47bd-9931-9056cae415b0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:42.160299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-443f6fa2-7f8d-47bd-9931-9056cae415b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:42.295181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1084/2181] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:42.303835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58595-6199-440d-844d-81ceb5fb8704 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:42.304026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58595-6199-440d-844d-81ceb5fb8704 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:42.304388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58595-6199-440d-844d-81ceb5fb8704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:42.365486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-a2f58595-6199-440d-844d-81ceb5fb8704 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:42.367647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a2f58595-6199-440d-844d-81ceb5fb8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:42.389296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1098/2182] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:42.390793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f6fa2-7f8d-47bd-9931-9056cae415b0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:42.402627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f6fa2-7f8d-47bd-9931-9056cae415b0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:42.408560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:42.409534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:42.410009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:42.410613 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:42.411813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:26:42.412383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:42.414227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:42.432131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1085/2183] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:26:42.433254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f58595-6199-440d-844d-81ceb5fb8704 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:42.446579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f58595-6199-440d-844d-81ceb5fb8704 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:42.453983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f7b9a-3a86-4e1d-a313-dd717dba1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:42.454888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f7b9a-3a86-4e1d-a313-dd717dba1f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:42.455167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f7b9a-3a86-4e1d-a313-dd717dba1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:42.455466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f7b9a-3a86-4e1d-a313-dd717dba1f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:42.456097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f7b9a-3a86-4e1d-a313-dd717dba1f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:42.458158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f7b9a-3a86-4e1d-a313-dd717dba1f38 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:42.584672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1099/2184] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:42 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:42.590797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:42.624288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ca75-1d7e-4084-8428-8efd399bfd24 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:42.746022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e652-7bf5-422b-9edc-652de0db8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:42.746775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e652-7bf5-422b-9edc-652de0db8f43 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:42.747136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e652-7bf5-422b-9edc-652de0db8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:42.748524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e652-7bf5-422b-9edc-652de0db8f43 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:42.749837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e652-7bf5-422b-9edc-652de0db8f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:42.753583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e652-7bf5-422b-9edc-652de0db8f43 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:42.870328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1086/2185] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:42 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:42.870591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f7b9a-3a86-4e1d-a313-dd717dba1f38 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:42.881961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f7b9a-3a86-4e1d-a313-dd717dba1f38 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:42.886936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2efe75-fef2-463e-aff5-96384ab01206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:42.887379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2efe75-fef2-463e-aff5-96384ab01206 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:42.887657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2efe75-fef2-463e-aff5-96384ab01206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:42.888466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2efe75-fef2-463e-aff5-96384ab01206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:42.889328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2efe75-fef2-463e-aff5-96384ab01206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:42.890931 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2efe75-fef2-463e-aff5-96384ab01206 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:42.901767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1100/2186] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:42.906677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e652-7bf5-422b-9edc-652de0db8f43 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:42.917335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e652-7bf5-422b-9edc-652de0db8f43 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:42.922489 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f78f6-b886-4d7a-afc1-a5e57cf1735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:42.923196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f78f6-b886-4d7a-afc1-a5e57cf1735d admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:42.923375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f78f6-b886-4d7a-afc1-a5e57cf1735d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:42.923643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f78f6-b886-4d7a-afc1-a5e57cf1735d admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:42.925027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f78f6-b886-4d7a-afc1-a5e57cf1735d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:42.927220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f78f6-b886-4d7a-afc1-a5e57cf1735d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:42.944319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1087/2187] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:42.944740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2efe75-fef2-463e-aff5-96384ab01206 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:42.956388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2efe75-fef2-463e-aff5-96384ab01206 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:42.960868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:42.961585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:42.961867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:42.962145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] PATH_INFO: `/v3/projects/86107f76ea8f456aa2fbc0a69c5db721/users/2a539a88ebd34644ac4a31371bfbf5e1/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:42.971795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:42.978502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86107f76ea8f456aa2fbc0a69c5db721, user_id=2a539a88ebd34644ac4a31371bfbf5e1, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:42.981313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:43.030866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d151-966e-4c4c-9342-b519f8422cd4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:43.031366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d151-966e-4c4c-9342-b519f8422cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:43.031732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d151-966e-4c4c-9342-b519f8422cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:43.055540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a409d151-966e-4c4c-9342-b519f8422cd4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:43.056906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a409d151-966e-4c4c-9342-b519f8422cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:43.066416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1088/2188] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:26:43.071201 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1101/2189] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:42 2022] PUT /identity/v3/projects/86107f76ea8f456aa2fbc0a69c5db721/users/2a539a88ebd34644ac4a31371bfbf5e1/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:43.083446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef65ed-ce6c-47c0-8137-3bf350a7b31f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:43.083730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef65ed-ce6c-47c0-8137-3bf350a7b31f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:43.083998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef65ed-ce6c-47c0-8137-3bf350a7b31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:43.101886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:43.101886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:43.127555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-75ef65ed-ce6c-47c0-8137-3bf350a7b31f None None] MFA Rules not processed for user `2a539a88ebd34644ac4a31371bfbf5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:43.128790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-75ef65ed-ce6c-47c0-8137-3bf350a7b31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:43.189664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:43.217100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1089/2190] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:43.221286 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1cfd-bce8-4f82-804d-d941df012f4f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:43.227376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd1df-37db-4b8e-8662-10115c6a59b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:43.228116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd1df-37db-4b8e-8662-10115c6a59b0 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:43.228497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd1df-37db-4b8e-8662-10115c6a59b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:43.228873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd1df-37db-4b8e-8662-10115c6a59b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:43.229154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef65ed-ce6c-47c0-8137-3bf350a7b31f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:43.230995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-75ef65ed-ce6c-47c0-8137-3bf350a7b31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:43.305380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef65ed-ce6c-47c0-8137-3bf350a7b31f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:43.310816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:43.311812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:43.312289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:43.312763 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:43.327881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:43.329726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:43.342144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccd1df-37db-4b8e-8662-10115c6a59b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:43.344170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccd1df-37db-4b8e-8662-10115c6a59b0 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:43.344288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1090/2191] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:43.362697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1102/2192] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:26:43.717682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:43.719756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:43.736343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05c0c7-ac9b-446c-a6eb-c58110ccd177 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:43.741595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:43.744614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:43.744614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:43.744614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] PATH_INFO: `/v3/users/d0aaa9a5b9ae4326bdcbf35eabd34649` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:43.745623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0aaa9a5b9ae4326bdcbf35eabd34649)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:43.748941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:43.937329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0aaa9a5b9ae4326bdcbf35eabd34649'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:43.938349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0aaa9a5b9ae4326bdcbf35eabd34649'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:43.938977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0aaa9a5b9ae4326bdcbf35eabd34649'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:43.967942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0aaa9a5b9ae4326bdcbf35eabd34649'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:44.076922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0aaa9a5b9ae4326bdcbf35eabd34649'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:44.100492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1091/2193] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:43 2022] DELETE /identity/v3/users/d0aaa9a5b9ae4326bdcbf35eabd34649 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:26:44.104779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0686dd1-fe86-469f-99ca-077049c273a6 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:44.105330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0686dd1-fe86-469f-99ca-077049c273a6 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:44.105330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0686dd1-fe86-469f-99ca-077049c273a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:44.147912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-e0686dd1-fe86-469f-99ca-077049c273a6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:44.149302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e0686dd1-fe86-469f-99ca-077049c273a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:44.257699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1103/2194] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:44.274914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:44.277168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:44.407785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697d6b-f521-44e1-b650-b536ea3e11a9 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:44.413000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaf7f5-36dd-4335-a9c5-dc94779dc62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:44.413804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf7f5-36dd-4335-a9c5-dc94779dc62b service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:44.414168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf7f5-36dd-4335-a9c5-dc94779dc62b service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:44.414360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf7f5-36dd-4335-a9c5-dc94779dc62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:44.435044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaf7f5-36dd-4335-a9c5-dc94779dc62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:44.438783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaf7f5-36dd-4335-a9c5-dc94779dc62b service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:44.459194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1092/2195] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:44.995970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0686dd1-fe86-469f-99ca-077049c273a6 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:44.997906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e0686dd1-fe86-469f-99ca-077049c273a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:45.024644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0686dd1-fe86-469f-99ca-077049c273a6 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:45.037586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:45.038255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:45.038535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:45.038806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] PATH_INFO: `/v3/projects/b4db4c86e7c54c60bbf12b1b1b70023b` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:45.049886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4db4c86e7c54c60bbf12b1b1b70023b)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:45.052056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:45.072019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:45.197710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4db4c86e7c54c60bbf12b1b1b70023b', 'request_id': 'req-1597336e-7802-45cf-a298-1c87f8ded246'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.224745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4db4c86e7c54c60bbf12b1b1b70023b', 'request_id': 'req-1597336e-7802-45cf-a298-1c87f8ded246'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.308375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4db4c86e7c54c60bbf12b1b1b70023b', 'request_id': 'req-1597336e-7802-45cf-a298-1c87f8ded246'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.342447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] The token cache is being invalidate because project b4db4c86e7c54c60bbf12b1b1b70023b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:45.346462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.349525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.358854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1104/2196] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:44 2022] DELETE /identity/v3/projects/b4db4c86e7c54c60bbf12b1b1b70023b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:45.362580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaf7f5-36dd-4335-a9c5-dc94779dc62b service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:45.368475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:45.374371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaf7f5-36dd-4335-a9c5-dc94779dc62b service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:45.534299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:45.535293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:45.543452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:45.543911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] PATH_INFO: `/v3/users/1ae82d249d764e64bb19778f6141be6c` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:45.553161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae82d249d764e64bb19778f6141be6c)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:45.557232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:45.830042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae82d249d764e64bb19778f6141be6c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.831201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae82d249d764e64bb19778f6141be6c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.831971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae82d249d764e64bb19778f6141be6c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.866580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae82d249d764e64bb19778f6141be6c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:45.995859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-270de825-3bc4-4f6b-b161-270dc8bd9261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae82d249d764e64bb19778f6141be6c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:46.022878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1093/2197] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:45 2022] DELETE /identity/v3/users/1ae82d249d764e64bb19778f6141be6c => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:46.914336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:46.916091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:46.975763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597336e-7802-45cf-a298-1c87f8ded246 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:47.140549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:47.141718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:47.142190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:47.142978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] PATH_INFO: `/v3/projects/5994b1c96bad4415b312c7242538f183` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:47.144525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5994b1c96bad4415b312c7242538f183)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:47.146775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:47.360964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5994b1c96bad4415b312c7242538f183', 'request_id': 'req-b4662680-41de-48f9-8b33-fc3537a814b7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:47.370235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5994b1c96bad4415b312c7242538f183', 'request_id': 'req-b4662680-41de-48f9-8b33-fc3537a814b7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:47.499738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5994b1c96bad4415b312c7242538f183', 'request_id': 'req-b4662680-41de-48f9-8b33-fc3537a814b7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:47.517089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] The token cache is being invalidate because project 5994b1c96bad4415b312c7242538f183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:26:47.517939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:47.519068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b4662680-41de-48f9-8b33-fc3537a814b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:47.536970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1105/2198] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:26:46 2022] DELETE /identity/v3/projects/5994b1c96bad4415b312c7242538f183 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:47.537411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8210-0e6f-444e-93c7-319b89727098 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:47.537855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8210-0e6f-444e-93c7-319b89727098 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:47.537967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8210-0e6f-444e-93c7-319b89727098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:47.563958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-578c8210-0e6f-444e-93c7-319b89727098 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:47.573234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-578c8210-0e6f-444e-93c7-319b89727098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:47.685718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd349bfa-a77b-48a7-94c0-7d0fdbc31667 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:47.686392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd349bfa-a77b-48a7-94c0-7d0fdbc31667 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:47.686834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd349bfa-a77b-48a7-94c0-7d0fdbc31667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:47.726606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-cd349bfa-a77b-48a7-94c0-7d0fdbc31667 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:47.730028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cd349bfa-a77b-48a7-94c0-7d0fdbc31667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:47.733550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1094/2199] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:26:47.745343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d084f8-f62f-49e1-9ac1-c3cfd01df22b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:47.745343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d084f8-f62f-49e1-9ac1-c3cfd01df22b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:47.745343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d084f8-f62f-49e1-9ac1-c3cfd01df22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:47.829443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-39d084f8-f62f-49e1-9ac1-c3cfd01df22b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:47.831701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-39d084f8-f62f-49e1-9ac1-c3cfd01df22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:47.845215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:47.847119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1095/2200] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:47.853046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d084f8-f62f-49e1-9ac1-c3cfd01df22b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:47.875493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d084f8-f62f-49e1-9ac1-c3cfd01df22b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:47.889915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:47.892594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:47.893069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:47.893945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:47.895663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:26:47.896805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:47.901715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:47.915643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1106/2201] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:26:47.930610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1096/2202] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:26:47.935522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd349bfa-a77b-48a7-94c0-7d0fdbc31667 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:47.950045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:47.955284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd349bfa-a77b-48a7-94c0-7d0fdbc31667 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:47.957568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:47.966439 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:47.970668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e981d-1fdd-405e-bc42-97905a8dde1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:47.974062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e981d-1fdd-405e-bc42-97905a8dde1d admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:47.974062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e981d-1fdd-405e-bc42-97905a8dde1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:47.974062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e981d-1fdd-405e-bc42-97905a8dde1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:47.974347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e981d-1fdd-405e-bc42-97905a8dde1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:47.979242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e981d-1fdd-405e-bc42-97905a8dde1d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:48.074779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdc6da-9182-4c83-a2cd-46b03d5eab8c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:48.082066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee8a2-c129-4218-a5e9-754e90db6ac0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:48.082793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee8a2-c129-4218-a5e9-754e90db6ac0 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:48.083105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee8a2-c129-4218-a5e9-754e90db6ac0 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:48.083475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbee8a2-c129-4218-a5e9-754e90db6ac0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:48.092854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbee8a2-c129-4218-a5e9-754e90db6ac0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:48.094631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbee8a2-c129-4218-a5e9-754e90db6ac0 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:48.106317 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1097/2203] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:26:48.127882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1107/2204] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:26:47 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:26:48.132333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee8a2-c129-4218-a5e9-754e90db6ac0 service swift] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:48.151041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbee8a2-c129-4218-a5e9-754e90db6ac0 service swift] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:48.220265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5bb8-bac0-4b59-9193-373236e7b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:48.220905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5bb8-bac0-4b59-9193-373236e7b20b admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:48.221209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5bb8-bac0-4b59-9193-373236e7b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:48.221481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5bb8-bac0-4b59-9193-373236e7b20b admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:48.222143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5bb8-bac0-4b59-9193-373236e7b20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:48.224238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5bb8-bac0-4b59-9193-373236e7b20b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:48.318216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1098/2205] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:26:48 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:26:48.322998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e981d-1fdd-405e-bc42-97905a8dde1d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:48.346661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e981d-1fdd-405e-bc42-97905a8dde1d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:48.375442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82774d6e-6c0a-4e8d-b3d9-c01a4b4504e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:48.376096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774d6e-6c0a-4e8d-b3d9-c01a4b4504e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:48.376367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774d6e-6c0a-4e8d-b3d9-c01a4b4504e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:48.376647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82774d6e-6c0a-4e8d-b3d9-c01a4b4504e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:48.378274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82774d6e-6c0a-4e8d-b3d9-c01a4b4504e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:48.380130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82774d6e-6c0a-4e8d-b3d9-c01a4b4504e8 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:48.420497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5bb8-bac0-4b59-9193-373236e7b20b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:48.434046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5bb8-bac0-4b59-9193-373236e7b20b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:48.435408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1108/2206] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:48.463652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34aa064-525c-4018-9690-c60dd451520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:48.476980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aa064-525c-4018-9690-c60dd451520a admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:48.476980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aa064-525c-4018-9690-c60dd451520a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:48.476980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aa064-525c-4018-9690-c60dd451520a admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:48.476980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34aa064-525c-4018-9690-c60dd451520a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:48.476980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34aa064-525c-4018-9690-c60dd451520a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:48.527393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82774d6e-6c0a-4e8d-b3d9-c01a4b4504e8 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:48.528122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1099/2207] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:26:48.543204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82774d6e-6c0a-4e8d-b3d9-c01a4b4504e8 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:48.561108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d6fa2-bf97-4146-b079-ee5fa8cc0525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:48.561986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d6fa2-bf97-4146-b079-ee5fa8cc0525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:48.562550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d6fa2-bf97-4146-b079-ee5fa8cc0525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:48.562842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d6fa2-bf97-4146-b079-ee5fa8cc0525 admin admin] PATH_INFO: `/v3/projects/e0c5f25287c34b56b2783b2d1b4421c1/users/e472a4fa22274a4ca1d948c286fc2440/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:48.646327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d6fa2-bf97-4146-b079-ee5fa8cc0525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c5f25287c34b56b2783b2d1b4421c1, user_id=e472a4fa22274a4ca1d948c286fc2440, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:48.657904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d6fa2-bf97-4146-b079-ee5fa8cc0525 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:48.847411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1109/2208] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:26:48 2022] PUT /identity/v3/projects/e0c5f25287c34b56b2783b2d1b4421c1/users/e472a4fa22274a4ca1d948c286fc2440/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:48.852200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7727a58-594c-4990-a09a-9b729e8139c1 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:48.852200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7727a58-594c-4990-a09a-9b729e8139c1 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:48.852200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7727a58-594c-4990-a09a-9b729e8139c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:48.903556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b7727a58-594c-4990-a09a-9b729e8139c1 None None] MFA Rules not processed for user `e472a4fa22274a4ca1d948c286fc2440`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:48.906462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b7727a58-594c-4990-a09a-9b729e8139c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:49.102924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:49.109934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1100/2209] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:49.922589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f239e1-f837-4e42-af63-038e743a82cf None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:49.923605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f239e1-f837-4e42-af63-038e743a82cf None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:49.924038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f239e1-f837-4e42-af63-038e743a82cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:49.977637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-35f239e1-f837-4e42-af63-038e743a82cf None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:49.981305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-35f239e1-f837-4e42-af63-038e743a82cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:50.124988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1110/2210] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:50.163437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7727a58-594c-4990-a09a-9b729e8139c1 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:50.164869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b7727a58-594c-4990-a09a-9b729e8139c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:50.285707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7727a58-594c-4990-a09a-9b729e8139c1 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:50.314056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f085f-a443-443b-81d7-6e489fb620b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:50.315007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f085f-a443-443b-81d7-6e489fb620b4 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:50.315288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f085f-a443-443b-81d7-6e489fb620b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:50.315562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f085f-a443-443b-81d7-6e489fb620b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:50.349043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f085f-a443-443b-81d7-6e489fb620b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:50.349043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f085f-a443-443b-81d7-6e489fb620b4 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:50.399581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1101/2211] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:54.084477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0bb0-dc6e-462d-ae1b-4c00bfe96d19 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:54.085082 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0bb0-dc6e-462d-ae1b-4c00bfe96d19 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:54.089291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0bb0-dc6e-462d-ae1b-4c00bfe96d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:54.133397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-fa6e0bb0-dc6e-462d-ae1b-4c00bfe96d19 None None] MFA Rules not processed for user `8a8974607c724b8a8b273502379a52a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:54.136069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fa6e0bb0-dc6e-462d-ae1b-4c00bfe96d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:54.270621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1111/2212] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:55.661194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92300fb-a24b-4931-b2e4-46fd929458b0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:55.663855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92300fb-a24b-4931-b2e4-46fd929458b0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:55.664359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92300fb-a24b-4931-b2e4-46fd929458b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:55.731083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e92300fb-a24b-4931-b2e4-46fd929458b0 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:55.738869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e92300fb-a24b-4931-b2e4-46fd929458b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:55.780026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1102/2213] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:56.134389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e0bb0-dc6e-462d-ae1b-4c00bfe96d19 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:56.160491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e0bb0-dc6e-462d-ae1b-4c00bfe96d19 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:56.170067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278796ec-610e-4dad-a060-3d16d2217c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:56.171117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278796ec-610e-4dad-a060-3d16d2217c98 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:56.171551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278796ec-610e-4dad-a060-3d16d2217c98 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:56.172050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278796ec-610e-4dad-a060-3d16d2217c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:56.192670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278796ec-610e-4dad-a060-3d16d2217c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:56.196781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278796ec-610e-4dad-a060-3d16d2217c98 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:56.219245 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1112/2214] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:26:58.331211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92300fb-a24b-4931-b2e4-46fd929458b0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:58.339569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e92300fb-a24b-4931-b2e4-46fd929458b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:58.364738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92300fb-a24b-4931-b2e4-46fd929458b0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:58.369557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:58.370200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:58.370480 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:58.370755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] PATH_INFO: `/v3/users/2a539a88ebd34644ac4a31371bfbf5e1` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:58.372049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a539a88ebd34644ac4a31371bfbf5e1)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:58.374198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:58.700906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a539a88ebd34644ac4a31371bfbf5e1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:58.702477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a539a88ebd34644ac4a31371bfbf5e1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:58.703301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a539a88ebd34644ac4a31371bfbf5e1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:58.723643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a539a88ebd34644ac4a31371bfbf5e1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:58.893616 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a539a88ebd34644ac4a31371bfbf5e1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:26:58.918529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1103/2215] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:26:58 2022] DELETE /identity/v3/users/2a539a88ebd34644ac4a31371bfbf5e1 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:26:58.921155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8e5f0-6cee-41eb-876d-b31a145f346f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:58.921672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8e5f0-6cee-41eb-876d-b31a145f346f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:58.921942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8e5f0-6cee-41eb-876d-b31a145f346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:58.952855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c9a8e5f0-6cee-41eb-876d-b31a145f346f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:26:58.956827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c9a8e5f0-6cee-41eb-876d-b31a145f346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:58.984462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:59.116964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1113/2216] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:26:59.140450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:26:59.142209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:26:59.308041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a95dd-b7ae-4306-b396-473af1e3102c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:26:59.319145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b9dd9-7164-409f-9f0d-112e192cdf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:26:59.319785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b9dd9-7164-409f-9f0d-112e192cdf3e service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:26:59.320062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b9dd9-7164-409f-9f0d-112e192cdf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:26:59.320333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b9dd9-7164-409f-9f0d-112e192cdf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:26:59.336854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:26:59.348549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b9dd9-7164-409f-9f0d-112e192cdf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:26:59.350261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b9dd9-7164-409f-9f0d-112e192cdf3e service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:26:59.395643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1104/2217] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:00.371533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8e5f0-6cee-41eb-876d-b31a145f346f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:00.374158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c9a8e5f0-6cee-41eb-876d-b31a145f346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:00.411040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8e5f0-6cee-41eb-876d-b31a145f346f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:00.425306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:00.430457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:00.432074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:00.433833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] PATH_INFO: `/v3/projects/86107f76ea8f456aa2fbc0a69c5db721` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:00.447687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86107f76ea8f456aa2fbc0a69c5db721)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:00.456926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:00.734987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86107f76ea8f456aa2fbc0a69c5db721', 'request_id': 'req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:00.750780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86107f76ea8f456aa2fbc0a69c5db721', 'request_id': 'req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:00.854344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86107f76ea8f456aa2fbc0a69c5db721', 'request_id': 'req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:00.878102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] The token cache is being invalidate because project 86107f76ea8f456aa2fbc0a69c5db721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:27:00.878416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:00.884291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:00.890955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1114/2218] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:27:00 2022] DELETE /identity/v3/projects/86107f76ea8f456aa2fbc0a69c5db721 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:01.846836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad52e6-34cf-4735-ae84-0f7017e10c17 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:01.847380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad52e6-34cf-4735-ae84-0f7017e10c17 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:01.847769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad52e6-34cf-4735-ae84-0f7017e10c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:01.889844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ccad52e6-34cf-4735-ae84-0f7017e10c17 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:01.891266 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ccad52e6-34cf-4735-ae84-0f7017e10c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:02.056691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1105/2219] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:02.078987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:02.080570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:02.334114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64c5c-05a0-42cb-b104-fc9494be4bc3 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:02.353266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca647-33b9-4ce8-9eb9-2ab05bae40b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:02.354318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca647-33b9-4ce8-9eb9-2ab05bae40b4 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:02.354698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca647-33b9-4ce8-9eb9-2ab05bae40b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:02.355076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca647-33b9-4ce8-9eb9-2ab05bae40b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:02.373505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca647-33b9-4ce8-9eb9-2ab05bae40b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:02.375308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca647-33b9-4ce8-9eb9-2ab05bae40b4 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:02.396751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1115/2220] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:05.145934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad52e6-34cf-4735-ae84-0f7017e10c17 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:05.148423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ccad52e6-34cf-4735-ae84-0f7017e10c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:05.258328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad52e6-34cf-4735-ae84-0f7017e10c17 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:05.262709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad56212b530461cb19f1bb2b4b14027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:05.264333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:05.264333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:05.264814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:05.266685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:05.340976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:05.342414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:05.352152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1106/2221] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:06.322104 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c3c9-64d2-41c7-980f-7d83002aab50 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:06.322608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c3c9-64d2-41c7-980f-7d83002aab50 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:06.322716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c3c9-64d2-41c7-980f-7d83002aab50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:06.343868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ddd9c3c9-64d2-41c7-980f-7d83002aab50 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:06.347153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ddd9c3c9-64d2-41c7-980f-7d83002aab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:06.370139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:06.416276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1116/2222] 10.222.0.93 () {58 vars in 967 bytes} [Thu Aug 4 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:06.430395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:06.431918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:06.470472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:06.530185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c445-1cd9-4158-a1f9-b530558a10c0 service glance] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:06.536935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:06.537553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:06.538098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:06.538383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:06.554270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:06.556043 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:06.566867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1107/2223] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:27:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:27:08.241687 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d70e2-bc9d-48df-b0f4-b6960a3e8629 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:08.242189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d70e2-bc9d-48df-b0f4-b6960a3e8629 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:08.242284 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d70e2-bc9d-48df-b0f4-b6960a3e8629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:08.261754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-5d1d70e2-bc9d-48df-b0f4-b6960a3e8629 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:08.263654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5d1d70e2-bc9d-48df-b0f4-b6960a3e8629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:08.272466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1117/2224] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:08.302540 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:08.303958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:08.323664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f100-05c9-4515-9405-7b3113593a96 service swift] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:08.330356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621edc6-c371-47fe-b723-fd1c01e7cec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:08.330967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621edc6-c371-47fe-b723-fd1c01e7cec5 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:08.331243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621edc6-c371-47fe-b723-fd1c01e7cec5 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:08.331507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621edc6-c371-47fe-b723-fd1c01e7cec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:08.340319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621edc6-c371-47fe-b723-fd1c01e7cec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:08.342678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621edc6-c371-47fe-b723-fd1c01e7cec5 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:08.352556 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1108/2225] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:09.997648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d70e2-bc9d-48df-b0f4-b6960a3e8629 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:09.999967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5d1d70e2-bc9d-48df-b0f4-b6960a3e8629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:10.014020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d70e2-bc9d-48df-b0f4-b6960a3e8629 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:10.019454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:10.020109 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:10.020388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:10.020658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] PATH_INFO: `/v3/users/f3aab051a9174adbb9f22b84414e0b46` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:10.021888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3aab051a9174adbb9f22b84414e0b46)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:10.024215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:10.249633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3aab051a9174adbb9f22b84414e0b46'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:10.258974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3aab051a9174adbb9f22b84414e0b46'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:10.370948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3aab051a9174adbb9f22b84414e0b46'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:10.384086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3aab051a9174adbb9f22b84414e0b46'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:10.384784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-86d36ff2-6109-4a2b-a33f-60b04a413522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3aab051a9174adbb9f22b84414e0b46'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:10.390989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1118/2226] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:27:09 2022] DELETE /identity/v3/users/f3aab051a9174adbb9f22b84414e0b46 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:10.739861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621edc6-c371-47fe-b723-fd1c01e7cec5 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:10.750647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621edc6-c371-47fe-b723-fd1c01e7cec5 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:10.809518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:10.810161 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:10.810440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:10.810716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] PATH_INFO: `/v3/projects/6be7930027004be189d399cdc3cc9d33` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:10.812014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be7930027004be189d399cdc3cc9d33)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:10.814210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:10.945750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be7930027004be189d399cdc3cc9d33', 'request_id': 'req-fd570a95-54a8-49c0-ad4f-30d083331bde'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:10.951243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be7930027004be189d399cdc3cc9d33', 'request_id': 'req-fd570a95-54a8-49c0-ad4f-30d083331bde'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:11.041933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be7930027004be189d399cdc3cc9d33', 'request_id': 'req-fd570a95-54a8-49c0-ad4f-30d083331bde'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:11.054627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] The token cache is being invalidate because project 6be7930027004be189d399cdc3cc9d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:27:11.054958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:11.056490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fd570a95-54a8-49c0-ad4f-30d083331bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:11.057363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1109/2227] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:27:10 2022] DELETE /identity/v3/projects/6be7930027004be189d399cdc3cc9d33 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:11.063604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3539c-ae9e-45c5-9d94-5edf3bd98813 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.064074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3539c-ae9e-45c5-9d94-5edf3bd98813 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.064164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3539c-ae9e-45c5-9d94-5edf3bd98813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.083715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-aee3539c-ae9e-45c5-9d94-5edf3bd98813 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:11.084977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-aee3539c-ae9e-45c5-9d94-5edf3bd98813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:11.146251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1119/2228] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:11.154412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df15f03-46f4-4c42-afdc-6fc93b2f1822 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.154693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df15f03-46f4-4c42-afdc-6fc93b2f1822 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.154963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df15f03-46f4-4c42-afdc-6fc93b2f1822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.175115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7df15f03-46f4-4c42-afdc-6fc93b2f1822 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:11.176319 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7df15f03-46f4-4c42-afdc-6fc93b2f1822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:11.184100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1110/2229] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:11.189414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3539c-ae9e-45c5-9d94-5edf3bd98813 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:11.200355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3539c-ae9e-45c5-9d94-5edf3bd98813 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:11.206679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:11.207610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.207988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.208288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.209275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:27:11.209671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:11.211674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:11.225660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1120/2230] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:27:11.230168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df15f03-46f4-4c42-afdc-6fc93b2f1822 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:11.240696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df15f03-46f4-4c42-afdc-6fc93b2f1822 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:11.245608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57c48f-f689-4246-b0d8-052abcaf9a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:11.246295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57c48f-f689-4246-b0d8-052abcaf9a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.246640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57c48f-f689-4246-b0d8-052abcaf9a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.246979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57c48f-f689-4246-b0d8-052abcaf9a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.247923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57c48f-f689-4246-b0d8-052abcaf9a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:11.250065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57c48f-f689-4246-b0d8-052abcaf9a05 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:11.403187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1111/2231] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:27:11 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:27:11.408155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:11.419637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8195-c3dd-4d84-93df-1cb725bf31fb admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:11.447256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:11.500184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d1fa-be86-42c7-b8a3-79c6dcd82a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:11.501018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d1fa-be86-42c7-b8a3-79c6dcd82a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.501305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d1fa-be86-42c7-b8a3-79c6dcd82a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.501581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d1fa-be86-42c7-b8a3-79c6dcd82a52 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.502286 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140d1fa-be86-42c7-b8a3-79c6dcd82a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:11.504571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140d1fa-be86-42c7-b8a3-79c6dcd82a52 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:11.609593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1121/2232] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:27:11 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:27:11.613714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57c48f-f689-4246-b0d8-052abcaf9a05 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:11.624796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57c48f-f689-4246-b0d8-052abcaf9a05 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:11.629525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e30d9-7bf3-4656-85df-2cb8a16d9c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:11.630209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e30d9-7bf3-4656-85df-2cb8a16d9c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.630481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e30d9-7bf3-4656-85df-2cb8a16d9c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.630747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e30d9-7bf3-4656-85df-2cb8a16d9c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.631513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e30d9-7bf3-4656-85df-2cb8a16d9c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:11.633094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e30d9-7bf3-4656-85df-2cb8a16d9c77 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:11.634437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:11.644298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1112/2233] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:27:11.648676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d1fa-be86-42c7-b8a3-79c6dcd82a52 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:11.660249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d1fa-be86-42c7-b8a3-79c6dcd82a52 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:11.664997 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62acf9-d954-4887-ac78-d786f7b0b9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:11.665610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62acf9-d954-4887-ac78-d786f7b0b9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.665891 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62acf9-d954-4887-ac78-d786f7b0b9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.666165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62acf9-d954-4887-ac78-d786f7b0b9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.666855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62acf9-d954-4887-ac78-d786f7b0b9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:11.668507 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62acf9-d954-4887-ac78-d786f7b0b9c6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:11.680274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1122/2234] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:27:11.685378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e30d9-7bf3-4656-85df-2cb8a16d9c77 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:11.695453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e30d9-7bf3-4656-85df-2cb8a16d9c77 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:11.700026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:11.700736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.701058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.701379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] PATH_INFO: `/v3/projects/0073f93c79e44168b419e8578e43adbe/users/8f980c8b84b246b2af3a6ecb0992e806/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.720227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0073f93c79e44168b419e8578e43adbe, user_id=8f980c8b84b246b2af3a6ecb0992e806, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:11.723213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:11.812930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1113/2235] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:27:11 2022] PUT /identity/v3/projects/0073f93c79e44168b419e8578e43adbe/users/8f980c8b84b246b2af3a6ecb0992e806/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:11.823262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b99e5-1b27-4854-b9fc-4ee20e6b1099 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:11.823548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b99e5-1b27-4854-b9fc-4ee20e6b1099 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:11.823821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b99e5-1b27-4854-b9fc-4ee20e6b1099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:11.851701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-5f9b99e5-1b27-4854-b9fc-4ee20e6b1099 None None] MFA Rules not processed for user `8f980c8b84b246b2af3a6ecb0992e806`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:11.852946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5f9b99e5-1b27-4854-b9fc-4ee20e6b1099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:11.927879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1123/2236] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:11.939919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:11.941640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:11.999452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f71b6a-d217-401e-8537-7d8557dd898b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:12.003343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab18b95-2d3f-42f6-9670-4f7b1654039a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:12.003956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18b95-2d3f-42f6-9670-4f7b1654039a service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:12.004234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18b95-2d3f-42f6-9670-4f7b1654039a service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:12.004502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18b95-2d3f-42f6-9670-4f7b1654039a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:12.012851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab18b95-2d3f-42f6-9670-4f7b1654039a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:12.014288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab18b95-2d3f-42f6-9670-4f7b1654039a service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:12.023240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1114/2237] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:14.571933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f759-f396-4038-8109-bf50616add7a None None] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:14.572452 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f759-f396-4038-8109-bf50616add7a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:14.572739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1f759-f396-4038-8109-bf50616add7a None None] PATH_INFO: `/` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:14.574186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1124/2238] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:27:14.588839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281e83d-25f8-4072-b6a2-1f5c290d67fe None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:14.589382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281e83d-25f8-4072-b6a2-1f5c290d67fe None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:14.589666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281e83d-25f8-4072-b6a2-1f5c290d67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:14.620695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a281e83d-25f8-4072-b6a2-1f5c290d67fe None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:14.622207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a281e83d-25f8-4072-b6a2-1f5c290d67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:14.630930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f43d58-49a6-4fea-8a1f-f9c2624db13a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:14.631214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f43d58-49a6-4fea-8a1f-f9c2624db13a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:14.631482 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f43d58-49a6-4fea-8a1f-f9c2624db13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:14.664199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-72f43d58-49a6-4fea-8a1f-f9c2624db13a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:14.665407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-72f43d58-49a6-4fea-8a1f-f9c2624db13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:14.764605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1125/2239] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:27:14.790467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1115/2240] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 04 21:27:14.799247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f43d58-49a6-4fea-8a1f-f9c2624db13a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:14.804616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-72f43d58-49a6-4fea-8a1f-f9c2624db13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:14.805459 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281e83d-25f8-4072-b6a2-1f5c290d67fe None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:14.807019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a281e83d-25f8-4072-b6a2-1f5c290d67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:14.825537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f43d58-49a6-4fea-8a1f-f9c2624db13a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:14.835665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c8775-a40c-4056-989d-115bbbb4b68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:14.836736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c8775-a40c-4056-989d-115bbbb4b68e service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:14.837262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c8775-a40c-4056-989d-115bbbb4b68e service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:14.837676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c8775-a40c-4056-989d-115bbbb4b68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:14.851801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c8775-a40c-4056-989d-115bbbb4b68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:14.854305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c8775-a40c-4056-989d-115bbbb4b68e service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:14.873769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1126/2241] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:14.875908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281e83d-25f8-4072-b6a2-1f5c290d67fe None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:14.880195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec359f9-d47a-4f3f-be89-2454694f34b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad56212b530461cb19f1bb2b4b14027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:14.882531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec359f9-d47a-4f3f-be89-2454694f34b4 service glance] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:14.882531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec359f9-d47a-4f3f-be89-2454694f34b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:14.882531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec359f9-d47a-4f3f-be89-2454694f34b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:14.894282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec359f9-d47a-4f3f-be89-2454694f34b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:14.895791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec359f9-d47a-4f3f-be89-2454694f34b4 service glance] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:14.918131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1116/2242] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:15.130975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c8775-a40c-4056-989d-115bbbb4b68e service nova] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:15.141590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c8775-a40c-4056-989d-115bbbb4b68e service nova] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:15.146348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:15.146980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.148055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.148336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] PATH_INFO: `/v3/users/8f980c8b84b246b2af3a6ecb0992e806` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.150334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f980c8b84b246b2af3a6ecb0992e806)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:15.151679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:15.164646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:15.222001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2b95c-17f0-41d5-a854-4134f82b6174 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.223252 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2b95c-17f0-41d5-a854-4134f82b6174 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.223252 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2b95c-17f0-41d5-a854-4134f82b6174 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.223896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1117/2243] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:27:15.228539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e36396-cbe5-4130-9835-682570df9562 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.229029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e36396-cbe5-4130-9835-682570df9562 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.229244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e36396-cbe5-4130-9835-682570df9562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.249819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-48e36396-cbe5-4130-9835-682570df9562 None None] MFA Rules not processed for user `a67b35a2567941f59dd746a3813b9d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:15.251039 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-48e36396-cbe5-4130-9835-682570df9562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:15.255954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:15.309819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1118/2244] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:27:15.326805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e36396-cbe5-4130-9835-682570df9562 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:15.328608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-48e36396-cbe5-4130-9835-682570df9562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:15.340715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e36396-cbe5-4130-9835-682570df9562 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:15.345383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ef4dd-966b-4e61-a0c8-6bc17c59b337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:15.346075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ef4dd-966b-4e61-a0c8-6bc17c59b337 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.346424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ef4dd-966b-4e61-a0c8-6bc17c59b337 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.346649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f980c8b84b246b2af3a6ecb0992e806'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:15.346816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ef4dd-966b-4e61-a0c8-6bc17c59b337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.353835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f980c8b84b246b2af3a6ecb0992e806'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:15.354430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ef4dd-966b-4e61-a0c8-6bc17c59b337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:15.359864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ef4dd-966b-4e61-a0c8-6bc17c59b337 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:15.364479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1119/2245] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:27:15.431065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f980c8b84b246b2af3a6ecb0992e806'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:15.457396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75000e0-73d1-4efb-aff1-7b92c9ed2ac6 None None] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.458297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75000e0-73d1-4efb-aff1-7b92c9ed2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.458706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75000e0-73d1-4efb-aff1-7b92c9ed2ac6 None None] PATH_INFO: `/` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.459447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f980c8b84b246b2af3a6ecb0992e806'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:15.460216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6b43b1d6-85f9-41b5-befb-63844d68a42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f980c8b84b246b2af3a6ecb0992e806'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:15.460920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1120/2246] 10.222.0.93 () {54 vars in 921 bytes} [Thu Aug 4 21:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:27:15.466490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd9d3-f3f4-40d1-bfee-6ab53237a0c9 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.469895 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd9d3-f3f4-40d1-bfee-6ab53237a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.469895 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd9d3-f3f4-40d1-bfee-6ab53237a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.470070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1127/2247] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:27:15 2022] DELETE /identity/v3/users/8f980c8b84b246b2af3a6ecb0992e806 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:15.474510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb74c3-db92-4207-8c39-c1b506b7b1af None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.474801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb74c3-db92-4207-8c39-c1b506b7b1af None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.475711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb74c3-db92-4207-8c39-c1b506b7b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.502587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-32fb74c3-db92-4207-8c39-c1b506b7b1af None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:15.503937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-32fb74c3-db92-4207-8c39-c1b506b7b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:15.510108 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b21dd9d3-f3f4-40d1-bfee-6ab53237a0c9 None None] MFA Rules not processed for user `66a82e8f2e304418adce1935fe7abcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:15.511307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b21dd9d3-f3f4-40d1-bfee-6ab53237a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:15.579843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1128/2248] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:15.590366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1121/2249] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Aug 4 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:15.590937 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb74c3-db92-4207-8c39-c1b506b7b1af None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:15.592321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-32fb74c3-db92-4207-8c39-c1b506b7b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:15.601490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd9d3-f3f4-40d1-bfee-6ab53237a0c9 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:15.603046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b21dd9d3-f3f4-40d1-bfee-6ab53237a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:15.654933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb74c3-db92-4207-8c39-c1b506b7b1af None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:15.659366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:15.659985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.660267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.660537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.670094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:15.671282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd9d3-f3f4-40d1-bfee-6ab53237a0c9 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:15.671595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:15.675381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538e30d-f249-4165-b571-8ff5c477ee09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:15.676001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538e30d-f249-4165-b571-8ff5c477ee09 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:15.676278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538e30d-f249-4165-b571-8ff5c477ee09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:15.676569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538e30d-f249-4165-b571-8ff5c477ee09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:15.681901 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1129/2250] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:27:15.687662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538e30d-f249-4165-b571-8ff5c477ee09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:15.689242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538e30d-f249-4165-b571-8ff5c477ee09 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:15.701486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1122/2251] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:27:16.303980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:16.305564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:16.319179 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3e299-cc4c-41fd-8980-61d4b4a0e8a9 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:16.323932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:16.324578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:16.324860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:16.325198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] PATH_INFO: `/v3/projects/0073f93c79e44168b419e8578e43adbe` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:16.326435 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0073f93c79e44168b419e8578e43adbe)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:16.330274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:16.412702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:16.429461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0073f93c79e44168b419e8578e43adbe', 'request_id': 'req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:16.434960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0073f93c79e44168b419e8578e43adbe', 'request_id': 'req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:16.559550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0073f93c79e44168b419e8578e43adbe', 'request_id': 'req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:16.579250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] The token cache is being invalidate because project 0073f93c79e44168b419e8578e43adbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:27:16.579250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:16.579948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0cff2f90-ed8f-400b-a66c-f1fe0d9e560a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:16.582657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1130/2252] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:27:16 2022] DELETE /identity/v3/projects/0073f93c79e44168b419e8578e43adbe => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:16.587917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01930d9-7210-4f35-be58-407130a7f655 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:16.592863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01930d9-7210-4f35-be58-407130a7f655 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:16.592863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01930d9-7210-4f35-be58-407130a7f655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:16.609032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f01930d9-7210-4f35-be58-407130a7f655 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:16.610450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f01930d9-7210-4f35-be58-407130a7f655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:16.653265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:16.676140 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1123/2253] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:16.690858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e314cb-8524-469e-bfd6-85acc4b751a1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:16.691167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e314cb-8524-469e-bfd6-85acc4b751a1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:16.691442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e314cb-8524-469e-bfd6-85acc4b751a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:16.711742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d0e314cb-8524-469e-bfd6-85acc4b751a1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:16.712976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d0e314cb-8524-469e-bfd6-85acc4b751a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:16.721674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1131/2254] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:16.726051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01930d9-7210-4f35-be58-407130a7f655 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:16.737297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01930d9-7210-4f35-be58-407130a7f655 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:16.742292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:16.742915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:16.743196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:16.743466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:16.744171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:27:16.744463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:16.746095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:16.758611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1124/2255] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:27:16.763106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e314cb-8524-469e-bfd6-85acc4b751a1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:16.773767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e314cb-8524-469e-bfd6-85acc4b751a1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:16.778815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1ed9a-a03b-4165-8a0c-28cb8a9e377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:16.779424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1ed9a-a03b-4165-8a0c-28cb8a9e377f admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:16.779726 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1ed9a-a03b-4165-8a0c-28cb8a9e377f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:16.780005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1ed9a-a03b-4165-8a0c-28cb8a9e377f admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:16.781222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1ed9a-a03b-4165-8a0c-28cb8a9e377f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:16.783186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1ed9a-a03b-4165-8a0c-28cb8a9e377f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:16.865480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1132/2256] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:27:16 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:27:16.869162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:16.880461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149e531-b2a5-43e4-a91f-548ca12474c2 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:16.944604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f736-4b9f-4902-be41-55193b7f2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:16.945178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f736-4b9f-4902-be41-55193b7f2e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:16.945457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f736-4b9f-4902-be41-55193b7f2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:16.945724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f736-4b9f-4902-be41-55193b7f2e83 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:16.946494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120f736-4b9f-4902-be41-55193b7f2e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:16.948408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120f736-4b9f-4902-be41-55193b7f2e83 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:17.019953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1125/2257] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:27:16 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:27:17.025498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1ed9a-a03b-4165-8a0c-28cb8a9e377f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:17.038186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1ed9a-a03b-4165-8a0c-28cb8a9e377f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:17.042972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feadaba-cac3-4d82-a2d6-fbca398aac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:17.043615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadaba-cac3-4d82-a2d6-fbca398aac46 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:17.043876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadaba-cac3-4d82-a2d6-fbca398aac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:17.044149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feadaba-cac3-4d82-a2d6-fbca398aac46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:17.044845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feadaba-cac3-4d82-a2d6-fbca398aac46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:17.046717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feadaba-cac3-4d82-a2d6-fbca398aac46 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:17.057921 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1133/2258] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:27:17.061989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f736-4b9f-4902-be41-55193b7f2e83 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:17.072775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f736-4b9f-4902-be41-55193b7f2e83 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:17.078352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeacadc-d085-49da-9a69-8a5e63029345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:17.078979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacadc-d085-49da-9a69-8a5e63029345 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:17.079262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacadc-d085-49da-9a69-8a5e63029345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:17.079534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeacadc-d085-49da-9a69-8a5e63029345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:17.080231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeacadc-d085-49da-9a69-8a5e63029345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:17.081897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeacadc-d085-49da-9a69-8a5e63029345 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:17.093585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1126/2259] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:27:17.097885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feadaba-cac3-4d82-a2d6-fbca398aac46 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:17.108275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feadaba-cac3-4d82-a2d6-fbca398aac46 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:17.125453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:17.125453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:17.125453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:17.125453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] PATH_INFO: `/v3/projects/443612213cd048e5b3cf83cb9ce06d5b/users/17c9f927c7e840fb8fd55347db5b7c0d/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:17.134523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443612213cd048e5b3cf83cb9ce06d5b, user_id=17c9f927c7e840fb8fd55347db5b7c0d, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:17.137335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:17.293860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1134/2260] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:27:17 2022] PUT /identity/v3/projects/443612213cd048e5b3cf83cb9ce06d5b/users/17c9f927c7e840fb8fd55347db5b7c0d/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:17.304531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525574-3029-40a6-9e69-9f3a71ac14a5 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:17.304814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525574-3029-40a6-9e69-9f3a71ac14a5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:17.305117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525574-3029-40a6-9e69-9f3a71ac14a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:17.336445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0a525574-3029-40a6-9e69-9f3a71ac14a5 None None] MFA Rules not processed for user `17c9f927c7e840fb8fd55347db5b7c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:17.337970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0a525574-3029-40a6-9e69-9f3a71ac14a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:17.459494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1127/2261] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:17.475908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:17.478692 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:17.583189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a510a-b6f1-4d2a-b927-4b5d4ebd6c05 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:17.586918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add45987-8676-4070-952e-65b4faea6de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:17.587645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45987-8676-4070-952e-65b4faea6de8 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:17.587941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45987-8676-4070-952e-65b4faea6de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:17.588197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45987-8676-4070-952e-65b4faea6de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:17.597005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add45987-8676-4070-952e-65b4faea6de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:17.598450 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add45987-8676-4070-952e-65b4faea6de8 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:17.607414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1135/2262] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:23.841897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525574-3029-40a6-9e69-9f3a71ac14a5 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:23.892786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:23.929409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525574-3029-40a6-9e69-9f3a71ac14a5 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:23.936498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:23.937876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:23.943353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:23.943353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] PATH_INFO: `/v3/users/17c9f927c7e840fb8fd55347db5b7c0d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:23.943353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c9f927c7e840fb8fd55347db5b7c0d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:23.943353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:24.145696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c9f927c7e840fb8fd55347db5b7c0d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:24.146382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c9f927c7e840fb8fd55347db5b7c0d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:24.146996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c9f927c7e840fb8fd55347db5b7c0d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:24.159617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c9f927c7e840fb8fd55347db5b7c0d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:24.234426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c9f927c7e840fb8fd55347db5b7c0d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:24.256956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1128/2263] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:27:23 2022] DELETE /identity/v3/users/17c9f927c7e840fb8fd55347db5b7c0d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:24.264370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25143-e577-469b-9753-41fabf0002e8 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:24.264370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25143-e577-469b-9753-41fabf0002e8 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:24.264370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25143-e577-469b-9753-41fabf0002e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:24.281381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-96c25143-e577-469b-9753-41fabf0002e8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:24.282696 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-96c25143-e577-469b-9753-41fabf0002e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:24.342389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:24.365234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1136/2264] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:24.369454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:24.370980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:24.444648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e677b-786d-4297-a3d9-f628b2c792aa admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:24.449334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76c8bf-84e7-48dd-82f7-400a11a4a412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:24.450103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76c8bf-84e7-48dd-82f7-400a11a4a412 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:24.450452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76c8bf-84e7-48dd-82f7-400a11a4a412 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:24.450798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76c8bf-84e7-48dd-82f7-400a11a4a412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:24.462524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76c8bf-84e7-48dd-82f7-400a11a4a412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:24.464344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76c8bf-84e7-48dd-82f7-400a11a4a412 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:24.474987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1129/2265] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:24.932441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25143-e577-469b-9753-41fabf0002e8 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:24.934013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-96c25143-e577-469b-9753-41fabf0002e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:24.948474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25143-e577-469b-9753-41fabf0002e8 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:24.951227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:24.951880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:24.952274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:24.952596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] PATH_INFO: `/v3/projects/443612213cd048e5b3cf83cb9ce06d5b` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:24.953994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443612213cd048e5b3cf83cb9ce06d5b)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:24.955931 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:25.077748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443612213cd048e5b3cf83cb9ce06d5b', 'request_id': 'req-98d7f612-fa32-4326-93a9-a03992fcee31'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:25.083495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443612213cd048e5b3cf83cb9ce06d5b', 'request_id': 'req-98d7f612-fa32-4326-93a9-a03992fcee31'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:25.162202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443612213cd048e5b3cf83cb9ce06d5b', 'request_id': 'req-98d7f612-fa32-4326-93a9-a03992fcee31'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:25.175025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] The token cache is being invalidate because project 443612213cd048e5b3cf83cb9ce06d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:27:25.175307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:25.175939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:25.177495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1137/2266] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:27:24 2022] DELETE /identity/v3/projects/443612213cd048e5b3cf83cb9ce06d5b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:30.083529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a60a-81ba-44db-af8f-500269b04670 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:30.084066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a60a-81ba-44db-af8f-500269b04670 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:30.084158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a60a-81ba-44db-af8f-500269b04670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:30.106603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3390a60a-81ba-44db-af8f-500269b04670 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:30.107961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3390a60a-81ba-44db-af8f-500269b04670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:30.181828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1130/2267] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:27:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:30.196041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:30.198092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:30.314779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7f612-fa32-4326-93a9-a03992fcee31 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:30.321304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575cac4-fec0-4ca9-9614-4b27011d2377 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:30.321999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575cac4-fec0-4ca9-9614-4b27011d2377 service swift] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:30.322388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575cac4-fec0-4ca9-9614-4b27011d2377 service swift] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:30.322599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575cac4-fec0-4ca9-9614-4b27011d2377 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:30.333645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575cac4-fec0-4ca9-9614-4b27011d2377 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:30.337933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575cac4-fec0-4ca9-9614-4b27011d2377 service swift] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:30.370225 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1138/2268] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:27:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:27:40.174022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:40.341911 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:41.971055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a60a-81ba-44db-af8f-500269b04670 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:41.973144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3390a60a-81ba-44db-af8f-500269b04670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:42.038570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a60a-81ba-44db-af8f-500269b04670 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:42.043206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:42.043837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:42.044114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:42.044382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] PATH_INFO: `/v3/users/e472a4fa22274a4ca1d948c286fc2440` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:42.045562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e472a4fa22274a4ca1d948c286fc2440)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:42.047473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:42.215480 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e472a4fa22274a4ca1d948c286fc2440'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:42.216127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e472a4fa22274a4ca1d948c286fc2440'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:42.216723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e472a4fa22274a4ca1d948c286fc2440'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:42.229580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e472a4fa22274a4ca1d948c286fc2440'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:42.275708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e472a4fa22274a4ca1d948c286fc2440'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:42.310229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1131/2269] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:27:41 2022] DELETE /identity/v3/users/e472a4fa22274a4ca1d948c286fc2440 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:42.311632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ed63-d2b7-4609-92f3-bc932ced566b None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:42.312146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ed63-d2b7-4609-92f3-bc932ced566b None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:42.312448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ed63-d2b7-4609-92f3-bc932ced566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:42.334251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-de64ed63-d2b7-4609-92f3-bc932ced566b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:42.335533 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-de64ed63-d2b7-4609-92f3-bc932ced566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:42.401885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1139/2270] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:42.412157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:42.413873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:42.475159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671470b-19a0-4196-b57c-ee35be8a53bb admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:42.478927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:42.479543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:42.479824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:42.480096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:42.491567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:42.493662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:42.509058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1132/2271] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:43.007274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ed63-d2b7-4609-92f3-bc932ced566b None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:43.008737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-de64ed63-d2b7-4609-92f3-bc932ced566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:43.024812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ed63-d2b7-4609-92f3-bc932ced566b None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:43.030548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:43.031058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:43.031403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:43.031571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] PATH_INFO: `/v3/projects/e0c5f25287c34b56b2783b2d1b4421c1` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:43.033421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c5f25287c34b56b2783b2d1b4421c1)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:43.035839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:43.136095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c5f25287c34b56b2783b2d1b4421c1', 'request_id': 'req-639c2fb5-c084-475b-8f8d-be8fecff1d9e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:43.141561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c5f25287c34b56b2783b2d1b4421c1', 'request_id': 'req-639c2fb5-c084-475b-8f8d-be8fecff1d9e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:43.198913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c5f25287c34b56b2783b2d1b4421c1', 'request_id': 'req-639c2fb5-c084-475b-8f8d-be8fecff1d9e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:43.210469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] The token cache is being invalidate because project e0c5f25287c34b56b2783b2d1b4421c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:27:43.210761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:43.211393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-639c2fb5-c084-475b-8f8d-be8fecff1d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:27:43.212967 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1140/2272] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:27:43 2022] DELETE /identity/v3/projects/e0c5f25287c34b56b2783b2d1b4421c1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:27:45.117041 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:45.118627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:45.155813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:45.203879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95852-419d-48b6-b14f-746b416566c6 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:45.276543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:45.277332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:45.277682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:45.278029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:45.279986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:45.293558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:45.295298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:45.306923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1133/2273] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:27:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:27:50.700516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e3041-88a5-4ec2-a5af-43d90e940239 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:50.700516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e3041-88a5-4ec2-a5af-43d90e940239 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:50.700516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e3041-88a5-4ec2-a5af-43d90e940239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:50.718959 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-325e3041-88a5-4ec2-a5af-43d90e940239 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:50.720307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-325e3041-88a5-4ec2-a5af-43d90e940239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:50.781628 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1141/2274] 10.222.0.93 () {58 vars in 967 bytes} [Thu Aug 4 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:27:50.806050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:27:50.808071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:50.878663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfd04c-d165-4b8f-be58-3fe0dbe57ecb service placement] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:27:50.883903 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4d809-0fd4-4c65-9840-38d7aed57360 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:27:50.884521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d809-0fd4-4c65-9840-38d7aed57360 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:50.884795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d809-0fd4-4c65-9840-38d7aed57360 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:50.885093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d809-0fd4-4c65-9840-38d7aed57360 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:50.893851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4d809-0fd4-4c65-9840-38d7aed57360 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:27:50.895430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4d809-0fd4-4c65-9840-38d7aed57360 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:27:50.903774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1134/2275] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:27:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:27:51.610249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99b3c1-d6cd-4eb8-af90-84d79be066da None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:27:51.610537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99b3c1-d6cd-4eb8-af90-84d79be066da None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:27:51.610815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99b3c1-d6cd-4eb8-af90-84d79be066da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:27:51.631115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-4d99b3c1-d6cd-4eb8-af90-84d79be066da None None] MFA Rules not processed for user `320eaae091af4326888b57dded0e807d`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:27:51.632498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4d99b3c1-d6cd-4eb8-af90-84d79be066da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:27:51.656984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:27:51.690475 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1142/2276] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:28:00.900601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=80 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:01.849013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=12 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:10.589240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80450d57-c0c9-41a0-8d5a-c5802e2156d5 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:10.589807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80450d57-c0c9-41a0-8d5a-c5802e2156d5 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:10.589807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80450d57-c0c9-41a0-8d5a-c5802e2156d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:10.609938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-80450d57-c0c9-41a0-8d5a-c5802e2156d5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:28:10.611166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-80450d57-c0c9-41a0-8d5a-c5802e2156d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:10.674628 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1135/2277] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:28:10.688697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99b3c1-d6cd-4eb8-af90-84d79be066da None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:28:10.690177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4d99b3c1-d6cd-4eb8-af90-84d79be066da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:10.776307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99b3c1-d6cd-4eb8-af90-84d79be066da None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:28:10.776307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7aa7-02be-407e-97a2-83375568d255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:28:10.776307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7aa7-02be-407e-97a2-83375568d255 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:10.776307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7aa7-02be-407e-97a2-83375568d255 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:10.776649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7aa7-02be-407e-97a2-83375568d255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:10.785204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e7aa7-02be-407e-97a2-83375568d255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:28:10.786794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e7aa7-02be-407e-97a2-83375568d255 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:28:10.796260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1143/2278] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:28:16.052047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905dfd5-f536-4179-b089-1488042deac8 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:16.052580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905dfd5-f536-4179-b089-1488042deac8 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:16.052580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905dfd5-f536-4179-b089-1488042deac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:16.071680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4905dfd5-f536-4179-b089-1488042deac8 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:28:16.072865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4905dfd5-f536-4179-b089-1488042deac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:16.080498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1136/2279] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:28:16.095955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7aa7-02be-407e-97a2-83375568d255 service nova] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:28:16.107903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7aa7-02be-407e-97a2-83375568d255 service nova] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:28:16.113955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:28:16.114556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:16.114836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:16.115118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:16.123485 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:28:16.125073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:28:16.134580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1144/2280] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:28:19.050123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cfc7-f093-48c3-a368-25e200f500b4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:19.050844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cfc7-f093-48c3-a368-25e200f500b4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:19.050844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cfc7-f093-48c3-a368-25e200f500b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:19.072068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1648cfc7-f093-48c3-a368-25e200f500b4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:28:19.073500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1648cfc7-f093-48c3-a368-25e200f500b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:19.083209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1137/2281] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:28:19.103043 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:28:19.104678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:19.120125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5900ab-9c93-4fc2-bb7f-7d7f8cb6df76 service nova] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:28:19.125734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec39823-bf29-42ca-8685-194a49b266e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:28:19.126417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39823-bf29-42ca-8685-194a49b266e2 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:19.126703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39823-bf29-42ca-8685-194a49b266e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:19.126980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39823-bf29-42ca-8685-194a49b266e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:19.136711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec39823-bf29-42ca-8685-194a49b266e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:28:19.138332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec39823-bf29-42ca-8685-194a49b266e2 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:28:19.149933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1145/2282] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:28:19.861075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a1adc-f4fc-466f-858f-7841010b87bc None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:19.861388 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a1adc-f4fc-466f-858f-7841010b87bc None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:19.861721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a1adc-f4fc-466f-858f-7841010b87bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:19.882286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3e0a1adc-f4fc-466f-858f-7841010b87bc None None] MFA Rules not processed for user `793d3d46e32b4550b711841f2447461a`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:28:19.883513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3e0a1adc-f4fc-466f-858f-7841010b87bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:19.940946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1138/2283] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:28:23.326841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5945c7-28d7-462f-87d9-5bf0fcfd8e10 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:23.327330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5945c7-28d7-462f-87d9-5bf0fcfd8e10 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:23.327443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5945c7-28d7-462f-87d9-5bf0fcfd8e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:23.349857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-fb5945c7-28d7-462f-87d9-5bf0fcfd8e10 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:28:23.351120 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fb5945c7-28d7-462f-87d9-5bf0fcfd8e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:23.359188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1146/2284] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:28:23.376402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a1adc-f4fc-466f-858f-7841010b87bc None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:28:23.389769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a1adc-f4fc-466f-858f-7841010b87bc None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:28:23.396106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f061-785e-4924-ab03-199d0c61cc87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:28:23.396664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f061-785e-4924-ab03-199d0c61cc87 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:23.397214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f061-785e-4924-ab03-199d0c61cc87 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:23.397633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f061-785e-4924-ab03-199d0c61cc87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:23.406585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4f061-785e-4924-ab03-199d0c61cc87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:28:23.408176 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4f061-785e-4924-ab03-199d0c61cc87 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:28:23.418962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1139/2285] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:28:27.593852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e466-6dc4-4802-92a1-3f2367723353 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:27.594368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e466-6dc4-4802-92a1-3f2367723353 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:27.594484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579e466-6dc4-4802-92a1-3f2367723353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:27.615994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-6579e466-6dc4-4802-92a1-3f2367723353 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:28:27.617254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6579e466-6dc4-4802-92a1-3f2367723353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:27.625437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1147/2286] 10.222.0.78 () {58 vars in 1016 bytes} [Thu Aug 4 21:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:28:27.649756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f061-785e-4924-ab03-199d0c61cc87 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:28:27.660301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f061-785e-4924-ab03-199d0c61cc87 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:28:27.665865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d21bbe-1534-4ac2-8c02-df417a43cc53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:28:27.666468 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d21bbe-1534-4ac2-8c02-df417a43cc53 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:27.666745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d21bbe-1534-4ac2-8c02-df417a43cc53 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:27.667016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d21bbe-1534-4ac2-8c02-df417a43cc53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:27.676179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d21bbe-1534-4ac2-8c02-df417a43cc53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:28:27.677802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d21bbe-1534-4ac2-8c02-df417a43cc53 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:28:27.688020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1140/2287] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:28:37.608840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=52 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:37.683288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=70 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:28:49.479611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b28a-b5f8-45af-b865-02f500d9b3db None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:28:49.480112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b28a-b5f8-45af-b865-02f500d9b3db None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:28:49.480226 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b28a-b5f8-45af-b865-02f500d9b3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:28:49.500018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-02f8b28a-b5f8-45af-b865-02f500d9b3db None None] MFA Rules not processed for user `06323c8fcf99441f9f87db199e93c8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:28:49.501278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-02f8b28a-b5f8-45af-b865-02f500d9b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:28:49.556733 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1148/2288] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:28:59.550209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=25 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:01.234036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba631c8-4fff-4cf4-99a8-1b7b37819e76 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:01.234833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba631c8-4fff-4cf4-99a8-1b7b37819e76 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:01.234833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba631c8-4fff-4cf4-99a8-1b7b37819e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:01.254375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9ba631c8-4fff-4cf4-99a8-1b7b37819e76 None None] MFA Rules not processed for user `8a8974607c724b8a8b273502379a52a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:29:01.255471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9ba631c8-4fff-4cf4-99a8-1b7b37819e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:01.315383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1141/2289] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:29:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:29:03.971907 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8b28a-b5f8-45af-b865-02f500d9b3db None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:03.973898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-02f8b28a-b5f8-45af-b865-02f500d9b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:03.989103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8b28a-b5f8-45af-b865-02f500d9b3db None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:03.994223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:03.994862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:03.995140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:03.995414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] PATH_INFO: `/v3/users/320eaae091af4326888b57dded0e807d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:03.996561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=320eaae091af4326888b57dded0e807d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:03.998590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:04.203922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '320eaae091af4326888b57dded0e807d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.214474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '320eaae091af4326888b57dded0e807d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.284876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '320eaae091af4326888b57dded0e807d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.302314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '320eaae091af4326888b57dded0e807d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.303439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-086e2761-6a44-4d93-9cfe-ffe06363b150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '320eaae091af4326888b57dded0e807d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.314260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1149/2290] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:29:03 2022] DELETE /identity/v3/users/320eaae091af4326888b57dded0e807d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:29:04.643663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba631c8-4fff-4cf4-99a8-1b7b37819e76 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:04.656101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba631c8-4fff-4cf4-99a8-1b7b37819e76 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:04.723026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:04.723856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:04.724136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:04.724406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] PATH_INFO: `/v3/projects/e72b946d3f26455bbf6d7330b0c2f5a2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:04.725594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72b946d3f26455bbf6d7330b0c2f5a2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:04.728730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:04.866974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72b946d3f26455bbf6d7330b0c2f5a2', 'request_id': 'req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.872944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72b946d3f26455bbf6d7330b0c2f5a2', 'request_id': 'req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.941699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72b946d3f26455bbf6d7330b0c2f5a2', 'request_id': 'req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.954523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] The token cache is being invalidate because project e72b946d3f26455bbf6d7330b0c2f5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:29:04.954811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.955447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:29:04.957064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1142/2291] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:29:04 2022] DELETE /identity/v3/projects/e72b946d3f26455bbf6d7330b0c2f5a2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:29:14.307831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:14.632727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4fb4-396b-4530-88ff-72ee83b996af None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:14.633272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4fb4-396b-4530-88ff-72ee83b996af None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:14.634314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4fb4-396b-4530-88ff-72ee83b996af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:14.654429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-4f8f4fb4-396b-4530-88ff-72ee83b996af None None] MFA Rules not processed for user `e6e5d240443d4a148346bf9f1270b1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:29:14.657632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4f8f4fb4-396b-4530-88ff-72ee83b996af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:14.719380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1150/2292] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:29:14.951671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:24.496718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:24.498243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:24.558145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea041db-e5c0-4d90-a9b3-4c5af084ee7b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:24.561881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab9d3d-c2e8-4c11-8fd1-172933851278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:24.562492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab9d3d-c2e8-4c11-8fd1-172933851278 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:24.562770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab9d3d-c2e8-4c11-8fd1-172933851278 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:24.563047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab9d3d-c2e8-4c11-8fd1-172933851278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:24.564822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ffab9d3d-c2e8-4c11-8fd1-172933851278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:24.643440 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab9d3d-c2e8-4c11-8fd1-172933851278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:24.644866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab9d3d-c2e8-4c11-8fd1-172933851278 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:24.657025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1143/2293] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:29:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:29:24.831217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=25 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:27.430867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4fb4-396b-4530-88ff-72ee83b996af None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:27.432382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4f8f4fb4-396b-4530-88ff-72ee83b996af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:27.490374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4fb4-396b-4530-88ff-72ee83b996af None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:27.494252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:27.494883 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:27.495166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:27.495439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:27.497262 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:27.512170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:27.513647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:27.525681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1151/2294] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:29:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:29:34.651881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=54 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:29:36.323774 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100244-41ac-49a6-b9b9-508a1e01a681 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:36.324433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100244-41ac-49a6-b9b9-508a1e01a681 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:36.324433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100244-41ac-49a6-b9b9-508a1e01a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:36.343746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-be100244-41ac-49a6-b9b9-508a1e01a681 None None] MFA Rules not processed for user `793d3d46e32b4550b711841f2447461a`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:29:36.345014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-be100244-41ac-49a6-b9b9-508a1e01a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:36.400461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1144/2295] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:29:36.713598 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:36.722372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9b5fe-c9f1-43f6-8304-fc9eab753361 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:36.726016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:36.726621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:36.726905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:36.727181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:36.729051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:36.738553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:36.740009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:36.748179 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1152/2296] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:29:41.717859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100244-41ac-49a6-b9b9-508a1e01a681 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:41.719350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-be100244-41ac-49a6-b9b9-508a1e01a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:41.735869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100244-41ac-49a6-b9b9-508a1e01a681 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:41.741299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:41.743865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:41.743865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:41.743865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:41.744215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:41.756747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:41.758430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:41.767590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1145/2297] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:29:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:29:46.053680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:46.063612 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f20da3-9a00-40bf-a6c4-e3b8ed6cd0ce service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:46.067370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:46.067976 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:46.068261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:46.068559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:46.070404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:46.129191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:46.130740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:46.140342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1153/2298] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:29:49.161380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:49.173330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249e38-ec00-41df-a822-8200743b7587 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:49.178909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:49.179521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:49.179797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:49.180067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:49.181800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:49.254022 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:49.255610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:49.265949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1146/2299] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:29:54.654822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:29:54.666221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a871a-475b-4ad2-81ca-54a0d5fe009e service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:29:54.685181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:29:54.686699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:29:54.687380 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:29:54.687866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:29:54.690423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:29:54.707160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:29:54.709703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:29:54.723759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1154/2300] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:29:59.260970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=59 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:03.583173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:03.585003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:03.600696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf54ad-0367-4afe-8e90-7b6b8d1b5c72 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:03.606315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2255419-fbc7-4f4a-ac49-80360c704fce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:03.606931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2255419-fbc7-4f4a-ac49-80360c704fce service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:03.607206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2255419-fbc7-4f4a-ac49-80360c704fce service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:03.607475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2255419-fbc7-4f4a-ac49-80360c704fce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:03.609779 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e2255419-fbc7-4f4a-ac49-80360c704fce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:03.622892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2255419-fbc7-4f4a-ac49-80360c704fce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:03.624498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2255419-fbc7-4f4a-ac49-80360c704fce service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:03.636311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1147/2301] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:04.716777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=66 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:11.150675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:11.152178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:11.163679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f719c-1e3a-4e45-bb96-b66227ad16a5 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:11.167484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:11.168086 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:11.168366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:11.168636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:11.170387 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:11.239893 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:11.241406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:11.254065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1155/2302] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:30:11.864617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d66ec9-b577-4440-839f-08e67d3784a6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:11.865159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d66ec9-b577-4440-839f-08e67d3784a6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:11.865333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d66ec9-b577-4440-839f-08e67d3784a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:11.889960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-34d66ec9-b577-4440-839f-08e67d3784a6 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:11.891755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-34d66ec9-b577-4440-839f-08e67d3784a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:11.951153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1148/2303] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:12.117259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:12.118683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:12.189237 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5934303-d68f-48fd-a5fb-7d0fe5759b55 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:12.194698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:12.195341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:12.195626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:12.195898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:12.207624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:12.209498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:12.218388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1156/2304] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:30:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:30:14.728586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d66ec9-b577-4440-839f-08e67d3784a6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:14.750011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d66ec9-b577-4440-839f-08e67d3784a6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:14.760357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:14.761561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:14.762198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:14.762991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:14.765302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:14.824848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:14.833928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:14.858967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1149/2305] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:16.309651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:16.311148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:16.332065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbb3d0-2891-4b19-a65a-b3222251c51e service swift] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:16.336575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:16.337299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:16.337600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:16.337903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] PATH_INFO: `/v3/users/8a8974607c724b8a8b273502379a52a9` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:16.339269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8974607c724b8a8b273502379a52a9)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:16.341371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:16.576664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8974607c724b8a8b273502379a52a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:16.584513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8974607c724b8a8b273502379a52a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:16.660057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8974607c724b8a8b273502379a52a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:16.681504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:16.683261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8974607c724b8a8b273502379a52a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:16.684229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b5d2865a-2baa-45ea-a6c3-6d42a08bc172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8974607c724b8a8b273502379a52a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:16.693534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1157/2306] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:30:16 2022] DELETE /identity/v3/users/8a8974607c724b8a8b273502379a52a9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:17.043520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:17.057823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21144507-a07f-420a-960e-5644a6518a8d service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:17.144444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:17.148157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:17.148157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:17.148157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] PATH_INFO: `/v3/projects/0d0c5e43053343cda8cd2a4a0f94c7d8` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:17.150386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0c5e43053343cda8cd2a4a0f94c7d8)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:17.152637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:17.280843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0c5e43053343cda8cd2a4a0f94c7d8', 'request_id': 'req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:17.288274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0c5e43053343cda8cd2a4a0f94c7d8', 'request_id': 'req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:17.353006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0c5e43053343cda8cd2a4a0f94c7d8', 'request_id': 'req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:17.368089 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] The token cache is being invalidate because project 0d0c5e43053343cda8cd2a4a0f94c7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:30:17.368458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:17.369251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-30a08d94-0e06-46ef-ad7c-a2e4d64efdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:17.371248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1150/2307] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:30:17 2022] DELETE /identity/v3/projects/0d0c5e43053343cda8cd2a4a0f94c7d8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:17.376263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676514-ec34-44f0-87bb-5ec857fba0c5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:17.376802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676514-ec34-44f0-87bb-5ec857fba0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:17.376802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676514-ec34-44f0-87bb-5ec857fba0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:17.399784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-4a676514-ec34-44f0-87bb-5ec857fba0c5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:17.401489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4a676514-ec34-44f0-87bb-5ec857fba0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:17.492198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1158/2308] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:17.501311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0e13-5cc0-468e-9f45-908a0ab794ff None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:17.502379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0e13-5cc0-468e-9f45-908a0ab794ff None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:17.503944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0e13-5cc0-468e-9f45-908a0ab794ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:17.547600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7b4a0e13-5cc0-468e-9f45-908a0ab794ff None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:17.548226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7b4a0e13-5cc0-468e-9f45-908a0ab794ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:17.560739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1151/2309] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:17.565147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a676514-ec34-44f0-87bb-5ec857fba0c5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:17.575316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a676514-ec34-44f0-87bb-5ec857fba0c5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:17.581320 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:17.582348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:17.582646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:17.583007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:17.583732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:30:17.584095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:17.585810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:17.603302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1159/2310] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:30:17.604355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0e13-5cc0-468e-9f45-908a0ab794ff None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:17.610905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:17.618430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0e13-5cc0-468e-9f45-908a0ab794ff None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:17.623366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aca97d-461a-42e8-b616-a039c274b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:17.623984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca97d-461a-42e8-b616-a039c274b68b admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:17.624256 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca97d-461a-42e8-b616-a039c274b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:17.624521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca97d-461a-42e8-b616-a039c274b68b admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:17.625843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aca97d-461a-42e8-b616-a039c274b68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:17.628302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aca97d-461a-42e8-b616-a039c274b68b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:17.778788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1152/2311] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:30:17 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:30:17.780304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:17.792054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb9f56-a104-4d12-afbb-806f43b3c7cb admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:17.886781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062cb0d-fd65-4f5a-8370-6537f8250b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:17.887700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062cb0d-fd65-4f5a-8370-6537f8250b26 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:17.888006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062cb0d-fd65-4f5a-8370-6537f8250b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:17.888391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062cb0d-fd65-4f5a-8370-6537f8250b26 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:17.889332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062cb0d-fd65-4f5a-8370-6537f8250b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:17.891887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062cb0d-fd65-4f5a-8370-6537f8250b26 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:18.008238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1160/2312] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:30:17 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:30:18.009564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aca97d-461a-42e8-b616-a039c274b68b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:18.021964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aca97d-461a-42e8-b616-a039c274b68b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:18.049222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3180a-592a-4157-85ba-43840885e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:18.051184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3180a-592a-4157-85ba-43840885e278 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:18.051687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3180a-592a-4157-85ba-43840885e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:18.052127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3180a-592a-4157-85ba-43840885e278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:18.053192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3180a-592a-4157-85ba-43840885e278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:18.055188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3180a-592a-4157-85ba-43840885e278 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:18.078769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062cb0d-fd65-4f5a-8370-6537f8250b26 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:18.079209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1153/2313] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:30:18.090410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062cb0d-fd65-4f5a-8370-6537f8250b26 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:18.097534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92fda0-06de-416e-815d-01be030ab3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:18.098241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fda0-06de-416e-815d-01be030ab3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:18.098522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fda0-06de-416e-815d-01be030ab3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:18.098854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fda0-06de-416e-815d-01be030ab3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:18.099565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92fda0-06de-416e-815d-01be030ab3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:18.101336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92fda0-06de-416e-815d-01be030ab3e1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:18.124413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1161/2314] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:18.128360 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3180a-592a-4157-85ba-43840885e278 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:18.146301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3180a-592a-4157-85ba-43840885e278 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:18.153507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:18.154490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:18.154993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:18.155497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] PATH_INFO: `/v3/projects/bd0f9dbf630740e7b572c5270363c952/users/50ab7ff3820d45e9990fc5accb804368/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:18.204478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0f9dbf630740e7b572c5270363c952, user_id=50ab7ff3820d45e9990fc5accb804368, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:18.212102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:18.306885 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1154/2315] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:30:18 2022] PUT /identity/v3/projects/bd0f9dbf630740e7b572c5270363c952/users/50ab7ff3820d45e9990fc5accb804368/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:18.322789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090e51-229d-44c8-857c-023b2c9020f9 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:18.323152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090e51-229d-44c8-857c-023b2c9020f9 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:18.323606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a090e51-229d-44c8-857c-023b2c9020f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:18.363885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1a090e51-229d-44c8-857c-023b2c9020f9 None None] MFA Rules not processed for user `50ab7ff3820d45e9990fc5accb804368`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:18.365408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1a090e51-229d-44c8-857c-023b2c9020f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:18.444793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:18.464099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1162/2316] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:18.475654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:18.478744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:18.555251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a2233-33e1-47c0-97f5-fd8cfee17982 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:18.559115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdc467-53a6-4f91-8554-4d46c175373b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:18.559748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdc467-53a6-4f91-8554-4d46c175373b service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:18.560030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdc467-53a6-4f91-8554-4d46c175373b service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:18.560367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdc467-53a6-4f91-8554-4d46c175373b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:18.571385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdc467-53a6-4f91-8554-4d46c175373b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:18.572443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdc467-53a6-4f91-8554-4d46c175373b service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:18.583574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1155/2317] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:28.577869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:28.672858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:29.232116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a090e51-229d-44c8-857c-023b2c9020f9 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:29.233411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1a090e51-229d-44c8-857c-023b2c9020f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:29.339445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdc467-53a6-4f91-8554-4d46c175373b service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:29.361530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a090e51-229d-44c8-857c-023b2c9020f9 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:29.372706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2fed8-552d-4c8f-806e-5fb7ae5dc488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:29.373772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2fed8-552d-4c8f-806e-5fb7ae5dc488 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:29.374252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2fed8-552d-4c8f-806e-5fb7ae5dc488 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:29.376151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2fed8-552d-4c8f-806e-5fb7ae5dc488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:29.380901 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-78e2fed8-552d-4c8f-806e-5fb7ae5dc488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:29.398488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2fed8-552d-4c8f-806e-5fb7ae5dc488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:29.400168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2fed8-552d-4c8f-806e-5fb7ae5dc488 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:29.412980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1163/2318] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:29.446466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdc467-53a6-4f91-8554-4d46c175373b service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:29.452194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:29.455650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:29.455650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:29.455650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] PATH_INFO: `/v3/users/50ab7ff3820d45e9990fc5accb804368` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:29.457488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ab7ff3820d45e9990fc5accb804368)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:29.460815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:29.678812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ab7ff3820d45e9990fc5accb804368'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:29.680426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ab7ff3820d45e9990fc5accb804368'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:29.686758 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ab7ff3820d45e9990fc5accb804368'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:29.709152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ab7ff3820d45e9990fc5accb804368'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:29.793478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ab7ff3820d45e9990fc5accb804368'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:29.807638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1156/2319] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:30:29 2022] DELETE /identity/v3/users/50ab7ff3820d45e9990fc5accb804368 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:29.812202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4840d-bbb7-4553-8f16-91fe3cfc8932 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:29.812910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4840d-bbb7-4553-8f16-91fe3cfc8932 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:29.812910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4840d-bbb7-4553-8f16-91fe3cfc8932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:29.840124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-5ba4840d-bbb7-4553-8f16-91fe3cfc8932 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:29.841382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5ba4840d-bbb7-4553-8f16-91fe3cfc8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:29.905183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1164/2320] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:29.915633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:29.917139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:29.977059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae898f-44f3-414e-81c8-a6655e04a033 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:29.980953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdae27-fde0-4828-b188-2cece9bd809c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:29.981653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdae27-fde0-4828-b188-2cece9bd809c service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:29.981833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdae27-fde0-4828-b188-2cece9bd809c service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:29.982103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdae27-fde0-4828-b188-2cece9bd809c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:29.993513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdae27-fde0-4828-b188-2cece9bd809c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:29.995278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdae27-fde0-4828-b188-2cece9bd809c service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:30.008522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1157/2321] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:30.468861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4840d-bbb7-4553-8f16-91fe3cfc8932 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:30.470349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5ba4840d-bbb7-4553-8f16-91fe3cfc8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:30.484424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4840d-bbb7-4553-8f16-91fe3cfc8932 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:30.495792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:30.496588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:30.496774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:30.506026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] PATH_INFO: `/v3/projects/bd0f9dbf630740e7b572c5270363c952` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:30.507276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0f9dbf630740e7b572c5270363c952)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:30.509453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:30.665463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0f9dbf630740e7b572c5270363c952', 'request_id': 'req-0790a215-67df-4c74-a1ae-a24358ed19c9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:30.671256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0f9dbf630740e7b572c5270363c952', 'request_id': 'req-0790a215-67df-4c74-a1ae-a24358ed19c9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:30.738904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0f9dbf630740e7b572c5270363c952', 'request_id': 'req-0790a215-67df-4c74-a1ae-a24358ed19c9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:30.751844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] The token cache is being invalidate because project bd0f9dbf630740e7b572c5270363c952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:30:30.752134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:30.752797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0790a215-67df-4c74-a1ae-a24358ed19c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:30.754510 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1165/2322] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:30:30 2022] DELETE /identity/v3/projects/bd0f9dbf630740e7b572c5270363c952 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:30.759445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f02f70-5fae-46f0-b4b9-776895e71788 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:30.759936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f02f70-5fae-46f0-b4b9-776895e71788 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:30.760030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f02f70-5fae-46f0-b4b9-776895e71788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:30.782785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-41f02f70-5fae-46f0-b4b9-776895e71788 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:30.789568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-41f02f70-5fae-46f0-b4b9-776895e71788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:30.814229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:30.861092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1158/2323] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:30:30.869310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba772ea9-fd1d-4ffc-abb5-09eded7f670a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:30.869819 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba772ea9-fd1d-4ffc-abb5-09eded7f670a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:30.869902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba772ea9-fd1d-4ffc-abb5-09eded7f670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:30.893923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ba772ea9-fd1d-4ffc-abb5-09eded7f670a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:30.895398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ba772ea9-fd1d-4ffc-abb5-09eded7f670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:30.904305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1166/2324] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:30.908796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f02f70-5fae-46f0-b4b9-776895e71788 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:30.919813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f02f70-5fae-46f0-b4b9-776895e71788 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:30.925116 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:30.925896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:30.926351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:30.926629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:30.927323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:30:30.929016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:30.930663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:30.946887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1159/2325] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:30:30.951812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba772ea9-fd1d-4ffc-abb5-09eded7f670a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:30.957285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:30.964963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba772ea9-fd1d-4ffc-abb5-09eded7f670a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:30.971371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7160fd8-59d0-4a9c-bea0-7d1629d6c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:30.972934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7160fd8-59d0-4a9c-bea0-7d1629d6c81d admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:30.972934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7160fd8-59d0-4a9c-bea0-7d1629d6c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:30.973231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7160fd8-59d0-4a9c-bea0-7d1629d6c81d admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:30.974116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7160fd8-59d0-4a9c-bea0-7d1629d6c81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:30.976669 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7160fd8-59d0-4a9c-bea0-7d1629d6c81d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:31.102769 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1167/2326] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:30:30 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:30:31.106769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:31.133092 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d007627-5fef-447a-b95a-63d7d8b54f94 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:31.193777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d01e29-2506-40e5-8436-b706edf2907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:31.194404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01e29-2506-40e5-8436-b706edf2907d admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:31.194681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01e29-2506-40e5-8436-b706edf2907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:31.194952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01e29-2506-40e5-8436-b706edf2907d admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:31.195625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d01e29-2506-40e5-8436-b706edf2907d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:31.197785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d01e29-2506-40e5-8436-b706edf2907d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:31.309252 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1160/2327] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:30:31 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:30:31.314442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7160fd8-59d0-4a9c-bea0-7d1629d6c81d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:31.326539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7160fd8-59d0-4a9c-bea0-7d1629d6c81d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:31.331256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9dd46-a669-4c76-87d7-c72a9c61b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:31.331998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9dd46-a669-4c76-87d7-c72a9c61b35e admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:31.332703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9dd46-a669-4c76-87d7-c72a9c61b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:31.333283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9dd46-a669-4c76-87d7-c72a9c61b35e admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:31.334090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9dd46-a669-4c76-87d7-c72a9c61b35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:31.339643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9dd46-a669-4c76-87d7-c72a9c61b35e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:31.349390 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1168/2328] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:31.353446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d01e29-2506-40e5-8436-b706edf2907d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:31.364390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d01e29-2506-40e5-8436-b706edf2907d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:31.369076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae8928-36b5-4619-845a-66286f3e9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:31.369691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8928-36b5-4619-845a-66286f3e9536 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:31.369962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8928-36b5-4619-845a-66286f3e9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:31.370271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8928-36b5-4619-845a-66286f3e9536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:31.370944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae8928-36b5-4619-845a-66286f3e9536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:31.372524 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae8928-36b5-4619-845a-66286f3e9536 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:31.384644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1161/2329] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:31.389055 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9dd46-a669-4c76-87d7-c72a9c61b35e admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:31.400622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9dd46-a669-4c76-87d7-c72a9c61b35e admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:31.405534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b5fb1-07ee-4cad-816f-da5ef64a5228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:31.406974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5fb1-07ee-4cad-816f-da5ef64a5228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:31.406974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5fb1-07ee-4cad-816f-da5ef64a5228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:31.406974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b5fb1-07ee-4cad-816f-da5ef64a5228 admin admin] PATH_INFO: `/v3/projects/7202a6c5fa9642c8a15c24ff9feb2275/users/96cab1ab9bb94cecac4eb9373116f111/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:31.427147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b5fb1-07ee-4cad-816f-da5ef64a5228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7202a6c5fa9642c8a15c24ff9feb2275, user_id=96cab1ab9bb94cecac4eb9373116f111, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:31.429916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b5fb1-07ee-4cad-816f-da5ef64a5228 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:31.515754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1169/2330] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:30:31 2022] PUT /identity/v3/projects/7202a6c5fa9642c8a15c24ff9feb2275/users/96cab1ab9bb94cecac4eb9373116f111/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:31.528569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b374-8c13-4fd1-9264-413f2e31779e None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:31.528969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b374-8c13-4fd1-9264-413f2e31779e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:31.529298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b374-8c13-4fd1-9264-413f2e31779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:31.565708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ff78b374-8c13-4fd1-9264-413f2e31779e None None] MFA Rules not processed for user `96cab1ab9bb94cecac4eb9373116f111`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:31.567026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ff78b374-8c13-4fd1-9264-413f2e31779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:31.647856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1162/2331] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:31.652432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b5fb1-07ee-4cad-816f-da5ef64a5228 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:31.732752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b5fb1-07ee-4cad-816f-da5ef64a5228 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:31.743844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079e8b6-31c8-4e0b-b6f7-6ccee3e6e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:31.745072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079e8b6-31c8-4e0b-b6f7-6ccee3e6e204 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:31.745765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079e8b6-31c8-4e0b-b6f7-6ccee3e6e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:31.746319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079e8b6-31c8-4e0b-b6f7-6ccee3e6e204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:31.747634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079e8b6-31c8-4e0b-b6f7-6ccee3e6e204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:31.751847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079e8b6-31c8-4e0b-b6f7-6ccee3e6e204 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:31.838948 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1170/2332] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:30:31 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:30:31.843451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78b374-8c13-4fd1-9264-413f2e31779e None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:31.855735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78b374-8c13-4fd1-9264-413f2e31779e None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:31.869931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:31.919082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d61d-56e7-410c-ba86-766745378eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:31.919701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d61d-56e7-410c-ba86-766745378eff admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:31.919978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d61d-56e7-410c-ba86-766745378eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:31.920251 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d61d-56e7-410c-ba86-766745378eff admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:31.920965 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d61d-56e7-410c-ba86-766745378eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:31.923641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d61d-56e7-410c-ba86-766745378eff admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:32.004804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1163/2333] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:30:31 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:30:32.009147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079e8b6-31c8-4e0b-b6f7-6ccee3e6e204 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:32.020980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079e8b6-31c8-4e0b-b6f7-6ccee3e6e204 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:32.026527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45480a-18e4-4bd8-91b3-cf8512793fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:32.027643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45480a-18e4-4bd8-91b3-cf8512793fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:32.028019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45480a-18e4-4bd8-91b3-cf8512793fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:32.028322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45480a-18e4-4bd8-91b3-cf8512793fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:32.029525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45480a-18e4-4bd8-91b3-cf8512793fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:32.032193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45480a-18e4-4bd8-91b3-cf8512793fa2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:32.045871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1171/2334] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:32.050776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d61d-56e7-410c-ba86-766745378eff admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:32.061765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d61d-56e7-410c-ba86-766745378eff admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:32.069144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e90c23-97ee-4788-972f-e70e89055915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:32.069827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e90c23-97ee-4788-972f-e70e89055915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:32.070105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e90c23-97ee-4788-972f-e70e89055915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:32.070402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e90c23-97ee-4788-972f-e70e89055915 admin admin] PATH_INFO: `/v3/projects/31737c9f327349fbbb2c3d4ba93d0079/users/dc9295dc67d34008ae0977f67725bf13/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:32.087355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e90c23-97ee-4788-972f-e70e89055915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31737c9f327349fbbb2c3d4ba93d0079, user_id=dc9295dc67d34008ae0977f67725bf13, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:32.090287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e90c23-97ee-4788-972f-e70e89055915 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:32.188770 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1164/2335] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:30:32 2022] PUT /identity/v3/projects/31737c9f327349fbbb2c3d4ba93d0079/users/dc9295dc67d34008ae0977f67725bf13/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:32.193567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45480a-18e4-4bd8-91b3-cf8512793fa2 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:32.212962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45480a-18e4-4bd8-91b3-cf8512793fa2 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:32.290582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4c5cd-0555-4d31-a189-36f5f9c7317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:32.291556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4c5cd-0555-4d31-a189-36f5f9c7317e admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:32.292045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4c5cd-0555-4d31-a189-36f5f9c7317e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:32.292532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4c5cd-0555-4d31-a189-36f5f9c7317e admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:32.293715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4c5cd-0555-4d31-a189-36f5f9c7317e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:32.297339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4c5cd-0555-4d31-a189-36f5f9c7317e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:32.312397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1172/2336] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:32.316852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e90c23-97ee-4788-972f-e70e89055915 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:32.336446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e90c23-97ee-4788-972f-e70e89055915 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:32.342065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:32.342829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:32.343141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:32.344099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] PATH_INFO: `/v3/projects/31737c9f327349fbbb2c3d4ba93d0079/users/dc9295dc67d34008ae0977f67725bf13/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:32.346423 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31737c9f327349fbbb2c3d4ba93d0079, user_id=dc9295dc67d34008ae0977f67725bf13, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:32.349290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:32.361138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1165/2337] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:30:32 2022] PUT /identity/v3/projects/31737c9f327349fbbb2c3d4ba93d0079/users/dc9295dc67d34008ae0977f67725bf13/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:32.373930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe985e-79ba-407f-a2f2-b7876f6f687a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:32.374212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe985e-79ba-407f-a2f2-b7876f6f687a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:32.374482 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe985e-79ba-407f-a2f2-b7876f6f687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:32.405715 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-a0fe985e-79ba-407f-a2f2-b7876f6f687a None None] MFA Rules not processed for user `dc9295dc67d34008ae0977f67725bf13`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:32.407618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a0fe985e-79ba-407f-a2f2-b7876f6f687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:32.411966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:32.489568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1173/2338] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:32.504386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:32.509781 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:32.571909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3af97-b9a0-4ab4-9389-c537477edfb4 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:32.575891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:32.576529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:32.576801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:32.577102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:32.590016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:32.591542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:32.605790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1166/2339] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:32.817356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe985e-79ba-407f-a2f2-b7876f6f687a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:32.840286 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe985e-79ba-407f-a2f2-b7876f6f687a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:32.845565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c150f3-21fd-461d-926f-5608b0370e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:32.850537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c150f3-21fd-461d-926f-5608b0370e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:32.850537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c150f3-21fd-461d-926f-5608b0370e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:32.850537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c150f3-21fd-461d-926f-5608b0370e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:32.922924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c150f3-21fd-461d-926f-5608b0370e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:32.930412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c150f3-21fd-461d-926f-5608b0370e77 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:32.935048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1174/2340] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:33.660539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:33.662147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:33.732303 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cc383-bc18-4c99-a2d3-2ad3027411a3 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:33.738275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:33.739076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:33.739353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:33.739627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:33.741411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:33.753112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:33.754677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:33.764449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1167/2341] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:37.603271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8524-bc26-4a9b-bc30-0ae08191b2df None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:37.604904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8524-bc26-4a9b-bc30-0ae08191b2df None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:37.605270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8524-bc26-4a9b-bc30-0ae08191b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:37.629215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-854e8524-bc26-4a9b-bc30-0ae08191b2df None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:37.630741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-854e8524-bc26-4a9b-bc30-0ae08191b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:37.700736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1175/2342] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:37.715326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:37.716956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:37.724741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:37.805979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13f97-ed0d-4ef3-80ec-34296616f12c service placement] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:37.810858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:37.811661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:37.812035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:37.812218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:37.822638 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:37.824625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:37.835080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1168/2343] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:30:44.495900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e8524-bc26-4a9b-bc30-0ae08191b2df None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:44.497699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-854e8524-bc26-4a9b-bc30-0ae08191b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:44.592608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:44.616568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e8524-bc26-4a9b-bc30-0ae08191b2df None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:44.620705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:44.621311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:44.621591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:44.622053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:44.628963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:44.718873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:44.721240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:44.733555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1176/2344] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:47.920470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=31 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:50.288133 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:50.289608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:50.304358 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79576b53-049d-4be1-a783-a7020ba486b9 service swift] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:50.309028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:50.309660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:50.309939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:50.310218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] PATH_INFO: `/v3/users/e6e5d240443d4a148346bf9f1270b1d5` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:50.311424 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e5d240443d4a148346bf9f1270b1d5)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:50.313402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:50.544156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e5d240443d4a148346bf9f1270b1d5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:50.545110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e5d240443d4a148346bf9f1270b1d5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:50.546144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e5d240443d4a148346bf9f1270b1d5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:50.565626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e5d240443d4a148346bf9f1270b1d5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:50.647849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5e293024-dabb-4e3b-a330-aa4623de4e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e5d240443d4a148346bf9f1270b1d5'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:50.661731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1169/2345] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:30:50 2022] DELETE /identity/v3/users/e6e5d240443d4a148346bf9f1270b1d5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:50.889549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:50.900940 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ba69-689a-4254-8b1d-577d27637a87 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:50.963686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:50.964389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:50.964910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:50.965255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] PATH_INFO: `/v3/projects/2f404475ba184654ba436a66969d1476` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:50.966474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f404475ba184654ba436a66969d1476)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:50.968919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:51.071603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f404475ba184654ba436a66969d1476', 'request_id': 'req-962ea5e0-4f41-412e-8f39-451c9156ca56'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:51.077905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f404475ba184654ba436a66969d1476', 'request_id': 'req-962ea5e0-4f41-412e-8f39-451c9156ca56'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:51.193277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f404475ba184654ba436a66969d1476', 'request_id': 'req-962ea5e0-4f41-412e-8f39-451c9156ca56'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:51.206440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] The token cache is being invalidate because project 2f404475ba184654ba436a66969d1476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:30:51.206734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:51.207392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-962ea5e0-4f41-412e-8f39-451c9156ca56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:51.209698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1177/2346] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:30:50 2022] DELETE /identity/v3/projects/2f404475ba184654ba436a66969d1476 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:51.214926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d819f-5c8b-4b74-a7c9-56f5461595a6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:51.215219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d819f-5c8b-4b74-a7c9-56f5461595a6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:51.215586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d819f-5c8b-4b74-a7c9-56f5461595a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:51.238150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-138d819f-5c8b-4b74-a7c9-56f5461595a6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:51.239465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-138d819f-5c8b-4b74-a7c9-56f5461595a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:51.313217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1170/2347] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:51.322483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d923-f0d2-42b1-8288-75efd6e1243d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:51.322758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d923-f0d2-42b1-8288-75efd6e1243d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:51.323105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d923-f0d2-42b1-8288-75efd6e1243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:51.346462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-8b55d923-f0d2-42b1-8288-75efd6e1243d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:51.347971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8b55d923-f0d2-42b1-8288-75efd6e1243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:51.357964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1178/2348] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:51.363815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d819f-5c8b-4b74-a7c9-56f5461595a6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:51.374531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d819f-5c8b-4b74-a7c9-56f5461595a6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:51.383743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:51.384383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:51.384658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:51.384964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:51.385665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:30:51.385995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:51.387896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:51.402502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1171/2349] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:30:51.407151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55d923-f0d2-42b1-8288-75efd6e1243d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:51.419114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55d923-f0d2-42b1-8288-75efd6e1243d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:51.425199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89d14-f95f-4d9c-994b-78c1fef395cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:51.425853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89d14-f95f-4d9c-994b-78c1fef395cd admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:51.426167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89d14-f95f-4d9c-994b-78c1fef395cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:51.426494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89d14-f95f-4d9c-994b-78c1fef395cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:51.427185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad89d14-f95f-4d9c-994b-78c1fef395cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:51.429388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad89d14-f95f-4d9c-994b-78c1fef395cd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:51.450400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:52.210301 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1179/2350] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:30:51 2022] POST /identity/v3/projects => generated 375 bytes in 804 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:30:52.217253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:52.237380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3054718-9585-4d5d-9d0c-457755bbd7a7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:52.310583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6558-e1bf-42e3-8e9d-ff7d6de9d553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:52.311202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6558-e1bf-42e3-8e9d-ff7d6de9d553 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:52.311481 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6558-e1bf-42e3-8e9d-ff7d6de9d553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:52.311776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6558-e1bf-42e3-8e9d-ff7d6de9d553 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:52.312446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6558-e1bf-42e3-8e9d-ff7d6de9d553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:52.314461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6558-e1bf-42e3-8e9d-ff7d6de9d553 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:52.322969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:52.472057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1172/2351] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:30:52 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:30:52.476311 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89d14-f95f-4d9c-994b-78c1fef395cd admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:52.486961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89d14-f95f-4d9c-994b-78c1fef395cd admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:52.491745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76431b6a-b769-401f-b60d-2cf6ffdfdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:52.492430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76431b6a-b769-401f-b60d-2cf6ffdfdb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:52.492705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76431b6a-b769-401f-b60d-2cf6ffdfdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:52.493011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76431b6a-b769-401f-b60d-2cf6ffdfdb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:52.493714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76431b6a-b769-401f-b60d-2cf6ffdfdb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:52.495324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76431b6a-b769-401f-b60d-2cf6ffdfdb79 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:52.512134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1180/2352] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:52.516217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6558-e1bf-42e3-8e9d-ff7d6de9d553 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:52.527343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6558-e1bf-42e3-8e9d-ff7d6de9d553 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:52.532543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae97d9-4741-47b4-9677-e48a43faf7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:52.538629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae97d9-4741-47b4-9677-e48a43faf7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:52.538629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae97d9-4741-47b4-9677-e48a43faf7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:52.538629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae97d9-4741-47b4-9677-e48a43faf7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:52.538629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae97d9-4741-47b4-9677-e48a43faf7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:52.538629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae97d9-4741-47b4-9677-e48a43faf7cf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:52.548119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1173/2353] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:52.552781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76431b6a-b769-401f-b60d-2cf6ffdfdb79 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:52.564121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76431b6a-b769-401f-b60d-2cf6ffdfdb79 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:52.569589 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:52.570267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:52.571838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:52.571838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] PATH_INFO: `/v3/projects/ada45d143d2d43629a59924612338aa4/users/d1f9149eb0be435c8163eae4ad593ef3/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:52.587000 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada45d143d2d43629a59924612338aa4, user_id=d1f9149eb0be435c8163eae4ad593ef3, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:52.589792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:52.672824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1181/2354] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:30:52 2022] PUT /identity/v3/projects/ada45d143d2d43629a59924612338aa4/users/d1f9149eb0be435c8163eae4ad593ef3/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:52.683629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc5a6-1331-4ab5-90b1-e8b9908d8dfb None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:52.683938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc5a6-1331-4ab5-90b1-e8b9908d8dfb None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:52.684207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc5a6-1331-4ab5-90b1-e8b9908d8dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:52.711685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-263cc5a6-1331-4ab5-90b1-e8b9908d8dfb None None] MFA Rules not processed for user `d1f9149eb0be435c8163eae4ad593ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:52.712928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-263cc5a6-1331-4ab5-90b1-e8b9908d8dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:52.781389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1174/2355] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:52.796609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:52.798916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:52.888512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d1aac-ba08-4900-8b49-71bcbbba1fc5 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:52.895785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda53ba-ccf5-4e7a-a773-6922e53a562c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:52.896725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda53ba-ccf5-4e7a-a773-6922e53a562c service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:52.897035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda53ba-ccf5-4e7a-a773-6922e53a562c service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:52.897307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda53ba-ccf5-4e7a-a773-6922e53a562c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:52.906317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda53ba-ccf5-4e7a-a773-6922e53a562c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:52.908703 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda53ba-ccf5-4e7a-a773-6922e53a562c service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:52.920040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1182/2356] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:53.241992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc5a6-1331-4ab5-90b1-e8b9908d8dfb None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:53.308408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc5a6-1331-4ab5-90b1-e8b9908d8dfb None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:53.313927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:53.314821 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:53.315910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:53.316061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] PATH_INFO: `/v3/users/d1f9149eb0be435c8163eae4ad593ef3` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:53.317403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f9149eb0be435c8163eae4ad593ef3)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:53.319596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:53.496755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f9149eb0be435c8163eae4ad593ef3'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:53.497412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f9149eb0be435c8163eae4ad593ef3'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:53.498046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f9149eb0be435c8163eae4ad593ef3'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:53.510631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f9149eb0be435c8163eae4ad593ef3'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:53.514450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:53.598451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f9149eb0be435c8163eae4ad593ef3'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:53.614387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1175/2357] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:30:53 2022] DELETE /identity/v3/users/d1f9149eb0be435c8163eae4ad593ef3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:53.619220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ac6f2-43fb-4bd8-b6a1-ddf6e3ca7937 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:53.619738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ac6f2-43fb-4bd8-b6a1-ddf6e3ca7937 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:53.619860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ac6f2-43fb-4bd8-b6a1-ddf6e3ca7937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:53.638585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-6b3ac6f2-43fb-4bd8-b6a1-ddf6e3ca7937 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:53.639792 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6b3ac6f2-43fb-4bd8-b6a1-ddf6e3ca7937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:53.709171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1183/2358] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:30:53.719471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:53.721504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:53.774431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00667ad8-27f2-4084-b17f-6eabaf5b7641 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:53.774625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00667ad8-27f2-4084-b17f-6eabaf5b7641 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:53.775391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00667ad8-27f2-4084-b17f-6eabaf5b7641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:53.790417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ffdb0-b145-4de2-b38d-189d76d7f8ee admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:53.794017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:53.795057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:53.795057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:53.796067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:53.798344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-00667ad8-27f2-4084-b17f-6eabaf5b7641 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:53.800153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-00667ad8-27f2-4084-b17f-6eabaf5b7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:53.806332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:53.807784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:53.819157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1176/2359] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:53.847205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:53.860818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1184/2360] 10.222.0.93 () {58 vars in 967 bytes} [Thu Aug 4 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:30:53.874688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:53.876067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:53.949746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f2fd8-6014-4167-b3aa-08e39ebec979 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:53.955620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47d773-fd06-44df-845a-68d841568543 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:53.956269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d773-fd06-44df-845a-68d841568543 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:53.956580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d773-fd06-44df-845a-68d841568543 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:53.956847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47d773-fd06-44df-845a-68d841568543 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:53.964867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d773-fd06-44df-845a-68d841568543 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:53.966450 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47d773-fd06-44df-845a-68d841568543 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:53.974778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1177/2361] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:30:54.293143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00667ad8-27f2-4084-b17f-6eabaf5b7641 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:54.294654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-00667ad8-27f2-4084-b17f-6eabaf5b7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:54.310001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00667ad8-27f2-4084-b17f-6eabaf5b7641 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:54.317353 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:54.320730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:54.320730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:54.320730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] PATH_INFO: `/v3/projects/ada45d143d2d43629a59924612338aa4` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:54.320730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada45d143d2d43629a59924612338aa4)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:54.321971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:54.448538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada45d143d2d43629a59924612338aa4', 'request_id': 'req-f6c570e7-099d-4be6-ae81-f310a829dd1e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:54.456149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada45d143d2d43629a59924612338aa4', 'request_id': 'req-f6c570e7-099d-4be6-ae81-f310a829dd1e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:54.535576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada45d143d2d43629a59924612338aa4', 'request_id': 'req-f6c570e7-099d-4be6-ae81-f310a829dd1e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:54.547837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] The token cache is being invalidate because project ada45d143d2d43629a59924612338aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:30:54.548393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:54.549675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f6c570e7-099d-4be6-ae81-f310a829dd1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:54.552210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1185/2362] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:30:54 2022] DELETE /identity/v3/projects/ada45d143d2d43629a59924612338aa4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:54.558044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baebc58-ec69-409d-8f88-ae3a3f2c98d2 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:54.559752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baebc58-ec69-409d-8f88-ae3a3f2c98d2 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:54.559752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baebc58-ec69-409d-8f88-ae3a3f2c98d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:54.581353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1baebc58-ec69-409d-8f88-ae3a3f2c98d2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:54.582559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1baebc58-ec69-409d-8f88-ae3a3f2c98d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:54.650347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1178/2363] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:54.659969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00a36d-69d8-4ee2-86ce-ba009bb68ec5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:54.660503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00a36d-69d8-4ee2-86ce-ba009bb68ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:54.660600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00a36d-69d8-4ee2-86ce-ba009bb68ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:54.690042 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ee00a36d-69d8-4ee2-86ce-ba009bb68ec5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:54.691983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ee00a36d-69d8-4ee2-86ce-ba009bb68ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:54.704700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1186/2364] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:54.710862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baebc58-ec69-409d-8f88-ae3a3f2c98d2 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:54.721060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baebc58-ec69-409d-8f88-ae3a3f2c98d2 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:54.726420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:54.727315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:54.730378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:54.730378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:54.730378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:30:54.730378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:54.730689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:54.743153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1179/2365] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:30:54.747540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00a36d-69d8-4ee2-86ce-ba009bb68ec5 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:54.758552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00a36d-69d8-4ee2-86ce-ba009bb68ec5 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:54.763445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141cb89-dd2d-4c8c-b8b0-8c6d438a6dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:54.764057 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141cb89-dd2d-4c8c-b8b0-8c6d438a6dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:54.764339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141cb89-dd2d-4c8c-b8b0-8c6d438a6dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:54.764613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141cb89-dd2d-4c8c-b8b0-8c6d438a6dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:54.765460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141cb89-dd2d-4c8c-b8b0-8c6d438a6dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:54.767984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141cb89-dd2d-4c8c-b8b0-8c6d438a6dc5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:54.874832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1187/2366] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:30:54 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:30:54.876006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:54.886761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e477c-be35-44c1-b41d-5248478b1214 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:54.890359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:54.946925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef9ab-7e5c-4eb0-a807-2dd13c2a34b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:54.948213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef9ab-7e5c-4eb0-a807-2dd13c2a34b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:54.948213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef9ab-7e5c-4eb0-a807-2dd13c2a34b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:54.948213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef9ab-7e5c-4eb0-a807-2dd13c2a34b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:54.948788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ef9ab-7e5c-4eb0-a807-2dd13c2a34b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:54.950772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ef9ab-7e5c-4eb0-a807-2dd13c2a34b1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.028937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1180/2367] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:30:54 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:30:55.030117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141cb89-dd2d-4c8c-b8b0-8c6d438a6dc5 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.040828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141cb89-dd2d-4c8c-b8b0-8c6d438a6dc5 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.045448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100d581-3ee3-4e51-8078-4cca588b962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.046112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100d581-3ee3-4e51-8078-4cca588b962a admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.046373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100d581-3ee3-4e51-8078-4cca588b962a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.046639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100d581-3ee3-4e51-8078-4cca588b962a admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.047330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100d581-3ee3-4e51-8078-4cca588b962a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.049444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100d581-3ee3-4e51-8078-4cca588b962a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.060234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1188/2368] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:55.064964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef9ab-7e5c-4eb0-a807-2dd13c2a34b1 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.075341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef9ab-7e5c-4eb0-a807-2dd13c2a34b1 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.080181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3e1a9-9643-4abe-bc15-a5839de766c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.080756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3e1a9-9643-4abe-bc15-a5839de766c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.081069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3e1a9-9643-4abe-bc15-a5839de766c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.081345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3e1a9-9643-4abe-bc15-a5839de766c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.082031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3e1a9-9643-4abe-bc15-a5839de766c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.083653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3e1a9-9643-4abe-bc15-a5839de766c5 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.094267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1181/2369] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:30:55.098716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100d581-3ee3-4e51-8078-4cca588b962a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.108640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100d581-3ee3-4e51-8078-4cca588b962a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.113919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9ea70-b685-4e7b-837d-a5efb9a4bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.114561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9ea70-b685-4e7b-837d-a5efb9a4bc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.114840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9ea70-b685-4e7b-837d-a5efb9a4bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.115110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9ea70-b685-4e7b-837d-a5efb9a4bc46 admin admin] PATH_INFO: `/v3/projects/2699c4c19a0f4453a0fbcc7ac4133080/users/2aa2d0373b22450e9fadcc2dd2599548/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.131494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9ea70-b685-4e7b-837d-a5efb9a4bc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2699c4c19a0f4453a0fbcc7ac4133080, user_id=2aa2d0373b22450e9fadcc2dd2599548, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.134199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9ea70-b685-4e7b-837d-a5efb9a4bc46 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.202305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1189/2370] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:30:55 2022] PUT /identity/v3/projects/2699c4c19a0f4453a0fbcc7ac4133080/users/2aa2d0373b22450e9fadcc2dd2599548/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:55.213340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4cc4-91ed-4b3b-a056-64ae34384bd0 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.213704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4cc4-91ed-4b3b-a056-64ae34384bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.213937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4cc4-91ed-4b3b-a056-64ae34384bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.243914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-268c4cc4-91ed-4b3b-a056-64ae34384bd0 None None] MFA Rules not processed for user `2aa2d0373b22450e9fadcc2dd2599548`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:55.245173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-268c4cc4-91ed-4b3b-a056-64ae34384bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:55.328227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1182/2371] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:55.333127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9ea70-b685-4e7b-837d-a5efb9a4bc46 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.404904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9ea70-b685-4e7b-837d-a5efb9a4bc46 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.411889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69881496-4e33-4fe4-a73d-bd5d82ce0091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.412490 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881496-4e33-4fe4-a73d-bd5d82ce0091 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.412784 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881496-4e33-4fe4-a73d-bd5d82ce0091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.413165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881496-4e33-4fe4-a73d-bd5d82ce0091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.413854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69881496-4e33-4fe4-a73d-bd5d82ce0091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.415809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69881496-4e33-4fe4-a73d-bd5d82ce0091 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.442523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:55.547838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1190/2372] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:30:55 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:30:55.552663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4cc4-91ed-4b3b-a056-64ae34384bd0 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.563924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4cc4-91ed-4b3b-a056-64ae34384bd0 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.624065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96801f-4fd2-4edf-bf2a-432cb4a7993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.624609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96801f-4fd2-4edf-bf2a-432cb4a7993f admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.624910 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96801f-4fd2-4edf-bf2a-432cb4a7993f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.625190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96801f-4fd2-4edf-bf2a-432cb4a7993f admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.625867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96801f-4fd2-4edf-bf2a-432cb4a7993f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.628601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96801f-4fd2-4edf-bf2a-432cb4a7993f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.747455 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1183/2373] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:30:55 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:30:55.751440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69881496-4e33-4fe4-a73d-bd5d82ce0091 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.762609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69881496-4e33-4fe4-a73d-bd5d82ce0091 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.767209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d8ec0-f27e-438e-a4a5-3907c274d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.768441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8ec0-f27e-438e-a4a5-3907c274d1af admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.768802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8ec0-f27e-438e-a4a5-3907c274d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.769106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8ec0-f27e-438e-a4a5-3907c274d1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.769803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d8ec0-f27e-438e-a4a5-3907c274d1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.771674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d8ec0-f27e-438e-a4a5-3907c274d1af admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.782400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1191/2374] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:55.787141 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96801f-4fd2-4edf-bf2a-432cb4a7993f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.793550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:55.797157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96801f-4fd2-4edf-bf2a-432cb4a7993f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.802018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e6efe-2f04-4e4b-9a4f-c9f9754b3fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.802675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6efe-2f04-4e4b-9a4f-c9f9754b3fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.807651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6efe-2f04-4e4b-9a4f-c9f9754b3fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.807651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6efe-2f04-4e4b-9a4f-c9f9754b3fa3 admin admin] PATH_INFO: `/v3/projects/8819f591f53549d8a28385601b9b3f38/users/cd605ffd2f05405cb1ae34c8298b7aa3/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.818618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e6efe-2f04-4e4b-9a4f-c9f9754b3fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8819f591f53549d8a28385601b9b3f38, user_id=cd605ffd2f05405cb1ae34c8298b7aa3, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.821414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e6efe-2f04-4e4b-9a4f-c9f9754b3fa3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.885340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1184/2375] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:30:55 2022] PUT /identity/v3/projects/8819f591f53549d8a28385601b9b3f38/users/cd605ffd2f05405cb1ae34c8298b7aa3/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:55.889211 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d8ec0-f27e-438e-a4a5-3907c274d1af admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.899851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d8ec0-f27e-438e-a4a5-3907c274d1af admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.957108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ec342-a097-4e0a-b9e8-f0bea1c68cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.957882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ec342-a097-4e0a-b9e8-f0bea1c68cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.958260 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ec342-a097-4e0a-b9e8-f0bea1c68cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.958609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ec342-a097-4e0a-b9e8-f0bea1c68cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.959305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ec342-a097-4e0a-b9e8-f0bea1c68cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.962842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ec342-a097-4e0a-b9e8-f0bea1c68cf7 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:55.971712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1192/2376] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:30:55.975933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e6efe-2f04-4e4b-9a4f-c9f9754b3fa3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:55.987768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e6efe-2f04-4e4b-9a4f-c9f9754b3fa3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:55.992124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:55.992782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:55.993109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:55.993382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] PATH_INFO: `/v3/projects/8819f591f53549d8a28385601b9b3f38/users/cd605ffd2f05405cb1ae34c8298b7aa3/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:55.996049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8819f591f53549d8a28385601b9b3f38, user_id=cd605ffd2f05405cb1ae34c8298b7aa3, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:55.998721 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:56.010900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1185/2377] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:30:55 2022] PUT /identity/v3/projects/8819f591f53549d8a28385601b9b3f38/users/cd605ffd2f05405cb1ae34c8298b7aa3/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:56.022088 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa436-6192-425b-8e7f-f066d7da6487 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:56.022635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa436-6192-425b-8e7f-f066d7da6487 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:56.023188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa436-6192-425b-8e7f-f066d7da6487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:56.053079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d32aa436-6192-425b-8e7f-f066d7da6487 None None] MFA Rules not processed for user `cd605ffd2f05405cb1ae34c8298b7aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:56.054348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d32aa436-6192-425b-8e7f-f066d7da6487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:56.133672 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1193/2378] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:56.146050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:56.148006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:56.206145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8df896-b41d-4da4-8148-bcd6b07a460a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:56.209778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656655c-5d0c-4b2d-a671-9e6f1e52b42d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:56.210385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656655c-5d0c-4b2d-a671-9e6f1e52b42d service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:56.210662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656655c-5d0c-4b2d-a671-9e6f1e52b42d service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:56.210937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656655c-5d0c-4b2d-a671-9e6f1e52b42d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:56.219789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656655c-5d0c-4b2d-a671-9e6f1e52b42d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:56.222016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656655c-5d0c-4b2d-a671-9e6f1e52b42d service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:56.231302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1186/2379] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:57.084339 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa436-6192-425b-8e7f-f066d7da6487 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:57.148419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa436-6192-425b-8e7f-f066d7da6487 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:57.153414 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:57.154058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:57.154338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:57.154610 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] PATH_INFO: `/v3/users/2aa2d0373b22450e9fadcc2dd2599548` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:57.155827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa2d0373b22450e9fadcc2dd2599548)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:57.160013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:57.166242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:57.349645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa2d0373b22450e9fadcc2dd2599548'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:57.357063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa2d0373b22450e9fadcc2dd2599548'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:57.430325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa2d0373b22450e9fadcc2dd2599548'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:57.444125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa2d0373b22450e9fadcc2dd2599548'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:57.444788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa2d0373b22450e9fadcc2dd2599548'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:57.450824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1194/2380] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:30:57 2022] DELETE /identity/v3/users/2aa2d0373b22450e9fadcc2dd2599548 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:57.455493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf899609-20a4-4d27-bd94-8f93bc393e15 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:57.455957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf899609-20a4-4d27-bd94-8f93bc393e15 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:57.455957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf899609-20a4-4d27-bd94-8f93bc393e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:57.475920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cf899609-20a4-4d27-bd94-8f93bc393e15 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:57.477328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cf899609-20a4-4d27-bd94-8f93bc393e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:57.556783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1187/2381] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:57.567551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:57.569091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:57.627497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d832-52a5-484a-921f-b3cf32b9cc21 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:57.631327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd569f0-7120-4b93-bea9-71ac3ada1beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:57.631971 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd569f0-7120-4b93-bea9-71ac3ada1beb service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:57.632251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd569f0-7120-4b93-bea9-71ac3ada1beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:57.633754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd569f0-7120-4b93-bea9-71ac3ada1beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:57.641656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd569f0-7120-4b93-bea9-71ac3ada1beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:57.643124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd569f0-7120-4b93-bea9-71ac3ada1beb service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:57.653045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1195/2382] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:58.135227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf899609-20a4-4d27-bd94-8f93bc393e15 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:58.136739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cf899609-20a4-4d27-bd94-8f93bc393e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:58.152032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf899609-20a4-4d27-bd94-8f93bc393e15 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:58.159331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:58.159991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:58.161069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:58.161069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] PATH_INFO: `/v3/projects/2699c4c19a0f4453a0fbcc7ac4133080` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:58.162151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2699c4c19a0f4453a0fbcc7ac4133080)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:58.164282 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:58.297829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2699c4c19a0f4453a0fbcc7ac4133080', 'request_id': 'req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.304390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2699c4c19a0f4453a0fbcc7ac4133080', 'request_id': 'req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.379491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2699c4c19a0f4453a0fbcc7ac4133080', 'request_id': 'req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.381013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:58.391609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] The token cache is being invalidate because project 2699c4c19a0f4453a0fbcc7ac4133080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:30:58.391899 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.392550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.395006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1188/2383] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:30:58 2022] DELETE /identity/v3/projects/2699c4c19a0f4453a0fbcc7ac4133080 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:58.399075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd569f0-7120-4b93-bea9-71ac3ada1beb service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:58.409285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd569f0-7120-4b93-bea9-71ac3ada1beb service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:58.470443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:58.472728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:58.472728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:58.472728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] PATH_INFO: `/v3/users/cd605ffd2f05405cb1ae34c8298b7aa3` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:58.473131 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd605ffd2f05405cb1ae34c8298b7aa3)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:58.474925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:58.661893 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:30:58.674932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd605ffd2f05405cb1ae34c8298b7aa3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.682019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd605ffd2f05405cb1ae34c8298b7aa3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.750554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd605ffd2f05405cb1ae34c8298b7aa3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.762478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd605ffd2f05405cb1ae34c8298b7aa3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.763200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd605ffd2f05405cb1ae34c8298b7aa3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:58.771594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1196/2384] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:30:58 2022] DELETE /identity/v3/users/cd605ffd2f05405cb1ae34c8298b7aa3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:59.142462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:59.144640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:59.342289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1fd3c-86d1-487e-9d4b-fa893ecba5a6 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:59.442712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd8eef-b476-47fc-8fa4-6ba50823f227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:59.443650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd8eef-b476-47fc-8fa4-6ba50823f227 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:59.443650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd8eef-b476-47fc-8fa4-6ba50823f227 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:59.444250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd8eef-b476-47fc-8fa4-6ba50823f227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:59.445944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1dcd8eef-b476-47fc-8fa4-6ba50823f227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:59.459340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd8eef-b476-47fc-8fa4-6ba50823f227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:59.461082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd8eef-b476-47fc-8fa4-6ba50823f227 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:59.476466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:30:59.478662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:59.481101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1189/2385] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:30:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:30:59.561749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881807fc-b535-498a-ade2-2908c07c4607 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:30:59.566511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:30:59.567160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:59.567442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:59.567719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] PATH_INFO: `/v3/projects/8819f591f53549d8a28385601b9b3f38` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:59.568947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8819f591f53549d8a28385601b9b3f38)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:30:59.570908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:30:59.727463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8819f591f53549d8a28385601b9b3f38', 'request_id': 'req-4eef1c5b-a302-411d-8805-80705f4f06a3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:59.733185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8819f591f53549d8a28385601b9b3f38', 'request_id': 'req-4eef1c5b-a302-411d-8805-80705f4f06a3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:59.861417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8819f591f53549d8a28385601b9b3f38', 'request_id': 'req-4eef1c5b-a302-411d-8805-80705f4f06a3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:59.874228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] The token cache is being invalidate because project 8819f591f53549d8a28385601b9b3f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:30:59.874521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:59.875170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4eef1c5b-a302-411d-8805-80705f4f06a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:30:59.877463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1197/2386] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:30:59 2022] DELETE /identity/v3/projects/8819f591f53549d8a28385601b9b3f38 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:30:59.882315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd55c1-2092-44ee-b50c-d36c617d3514 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:59.882755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd55c1-2092-44ee-b50c-d36c617d3514 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:59.883024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd55c1-2092-44ee-b50c-d36c617d3514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:30:59.904741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0ddd55c1-2092-44ee-b50c-d36c617d3514 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:30:59.906014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0ddd55c1-2092-44ee-b50c-d36c617d3514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:30:59.994456 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1190/2387] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:30:59.996306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d661a-fd37-41c1-9fb4-b178581e9f85 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:30:59.996588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d661a-fd37-41c1-9fb4-b178581e9f85 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:30:59.996862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d661a-fd37-41c1-9fb4-b178581e9f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.019136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ae7d661a-fd37-41c1-9fb4-b178581e9f85 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:00.020542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ae7d661a-fd37-41c1-9fb4-b178581e9f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:00.028736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1198/2388] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:00.033407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd55c1-2092-44ee-b50c-d36c617d3514 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:00.045355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd55c1-2092-44ee-b50c-d36c617d3514 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:00.052187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:00.053195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.053580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.053852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.054548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:00.054853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:00.056575 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:00.071607 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1191/2389] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:00.075939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d661a-fd37-41c1-9fb4-b178581e9f85 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:00.086537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d661a-fd37-41c1-9fb4-b178581e9f85 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:00.091591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e34ef-2d7b-4a85-8282-de493a041a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:00.092220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e34ef-2d7b-4a85-8282-de493a041a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.092504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e34ef-2d7b-4a85-8282-de493a041a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.092781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e34ef-2d7b-4a85-8282-de493a041a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.093934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e34ef-2d7b-4a85-8282-de493a041a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:00.095905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e34ef-2d7b-4a85-8282-de493a041a10 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:00.195688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1199/2390] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:00 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:00.199845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:00.211099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:00.215612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e28597-10a6-40a5-8c8b-2da43c8528de admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:00.281332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af59f7-e188-4be7-b536-4463fd1da8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:00.281960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af59f7-e188-4be7-b536-4463fd1da8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.282241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af59f7-e188-4be7-b536-4463fd1da8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.282511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af59f7-e188-4be7-b536-4463fd1da8ae admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.283206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af59f7-e188-4be7-b536-4463fd1da8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:00.285635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af59f7-e188-4be7-b536-4463fd1da8ae admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:00.387551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1192/2391] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:00 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:00.391797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e34ef-2d7b-4a85-8282-de493a041a10 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:00.409287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e34ef-2d7b-4a85-8282-de493a041a10 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:00.414618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b91c4-f6b6-4d2c-aa3b-e299e6d8f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:00.415247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b91c4-f6b6-4d2c-aa3b-e299e6d8f76f admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.415532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b91c4-f6b6-4d2c-aa3b-e299e6d8f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.415796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b91c4-f6b6-4d2c-aa3b-e299e6d8f76f admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.416590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b91c4-f6b6-4d2c-aa3b-e299e6d8f76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:00.418238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b91c4-f6b6-4d2c-aa3b-e299e6d8f76f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:00.420860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:00.430367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1200/2392] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:00.434396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af59f7-e188-4be7-b536-4463fd1da8ae admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:00.446254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af59f7-e188-4be7-b536-4463fd1da8ae admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:00.451170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d2d9e-1b47-4cf3-8893-ae6df3b0f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:00.451694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2d9e-1b47-4cf3-8893-ae6df3b0f6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.451972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2d9e-1b47-4cf3-8893-ae6df3b0f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.452528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d2d9e-1b47-4cf3-8893-ae6df3b0f6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.453250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d2d9e-1b47-4cf3-8893-ae6df3b0f6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:00.454834 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d2d9e-1b47-4cf3-8893-ae6df3b0f6b8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:00.470474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1193/2393] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:00.471615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b91c4-f6b6-4d2c-aa3b-e299e6d8f76f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:00.482151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b91c4-f6b6-4d2c-aa3b-e299e6d8f76f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:00.487887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df9ce6-58d3-4d14-b41c-96dc01ace54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:00.488714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df9ce6-58d3-4d14-b41c-96dc01ace54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.495345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df9ce6-58d3-4d14-b41c-96dc01ace54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.495345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df9ce6-58d3-4d14-b41c-96dc01ace54f admin admin] PATH_INFO: `/v3/projects/43f5e632531a416f8375ad8b22d7283b/users/5c7a723ee3cb427b873a1eee1278f422/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.505436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df9ce6-58d3-4d14-b41c-96dc01ace54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f5e632531a416f8375ad8b22d7283b, user_id=5c7a723ee3cb427b873a1eee1278f422, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:00.508128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df9ce6-58d3-4d14-b41c-96dc01ace54f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:00.608090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1201/2394] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:00 2022] PUT /identity/v3/projects/43f5e632531a416f8375ad8b22d7283b/users/5c7a723ee3cb427b873a1eee1278f422/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:00.619971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a9385-e38a-4460-be74-e5d5c5d269fa None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.620260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a9385-e38a-4460-be74-e5d5c5d269fa None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.620602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a9385-e38a-4460-be74-e5d5c5d269fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.649927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e28a9385-e38a-4460-be74-e5d5c5d269fa None None] MFA Rules not processed for user `5c7a723ee3cb427b873a1eee1278f422`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:00.651410 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e28a9385-e38a-4460-be74-e5d5c5d269fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:00.718726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1194/2395] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:00.724139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df9ce6-58d3-4d14-b41c-96dc01ace54f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:00.803411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df9ce6-58d3-4d14-b41c-96dc01ace54f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:00.808010 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e51f-1e17-4d1f-beb0-4fe3b33cfbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:00.808632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e51f-1e17-4d1f-beb0-4fe3b33cfbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.808945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e51f-1e17-4d1f-beb0-4fe3b33cfbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.809223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e51f-1e17-4d1f-beb0-4fe3b33cfbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.809892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742e51f-1e17-4d1f-beb0-4fe3b33cfbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:00.811853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742e51f-1e17-4d1f-beb0-4fe3b33cfbf1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:00.907257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1202/2396] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:00 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:00.912135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a9385-e38a-4460-be74-e5d5c5d269fa None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:00.923051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a9385-e38a-4460-be74-e5d5c5d269fa None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:00.984278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01b20d-37e8-4dba-b275-3bec80fcb86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:00.984928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b20d-37e8-4dba-b275-3bec80fcb86c admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:00.985211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b20d-37e8-4dba-b275-3bec80fcb86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:00.985485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b20d-37e8-4dba-b275-3bec80fcb86c admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:00.986143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01b20d-37e8-4dba-b275-3bec80fcb86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:00.988917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01b20d-37e8-4dba-b275-3bec80fcb86c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:01.061525 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1195/2397] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:00 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:01.065859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e51f-1e17-4d1f-beb0-4fe3b33cfbf1 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:01.076700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e51f-1e17-4d1f-beb0-4fe3b33cfbf1 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:01.086597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2509a-9142-41cf-95ea-625149fe9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:01.090174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2509a-9142-41cf-95ea-625149fe9f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:01.090968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2509a-9142-41cf-95ea-625149fe9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:01.090968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2509a-9142-41cf-95ea-625149fe9f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:01.091542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2509a-9142-41cf-95ea-625149fe9f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:01.093327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2509a-9142-41cf-95ea-625149fe9f56 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:01.106029 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1203/2398] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:01.116660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01b20d-37e8-4dba-b275-3bec80fcb86c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:01.122729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:01.129432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01b20d-37e8-4dba-b275-3bec80fcb86c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:01.134484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1567ad-c363-4b4e-a8c8-9dc2f6ca3302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:01.135233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1567ad-c363-4b4e-a8c8-9dc2f6ca3302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:01.135502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1567ad-c363-4b4e-a8c8-9dc2f6ca3302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:01.136934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1567ad-c363-4b4e-a8c8-9dc2f6ca3302 admin admin] PATH_INFO: `/v3/projects/9ac8c2cef08845d28420d370849fe553/users/7d67ff6939664dbf8e35155f2afea9a1/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:01.151764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1567ad-c363-4b4e-a8c8-9dc2f6ca3302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac8c2cef08845d28420d370849fe553, user_id=7d67ff6939664dbf8e35155f2afea9a1, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:01.154466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1567ad-c363-4b4e-a8c8-9dc2f6ca3302 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:01.219766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1196/2399] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:01 2022] PUT /identity/v3/projects/9ac8c2cef08845d28420d370849fe553/users/7d67ff6939664dbf8e35155f2afea9a1/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:01.224407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2509a-9142-41cf-95ea-625149fe9f56 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:01.234836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2509a-9142-41cf-95ea-625149fe9f56 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:01.298780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c0e6e-956e-4ec3-942a-b7c80e847f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:01.299728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0e6e-956e-4ec3-942a-b7c80e847f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:01.300185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0e6e-956e-4ec3-942a-b7c80e847f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:01.300439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0e6e-956e-4ec3-942a-b7c80e847f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:01.301250 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c0e6e-956e-4ec3-942a-b7c80e847f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:01.303116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c0e6e-956e-4ec3-942a-b7c80e847f0c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:01.315413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1204/2400] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:01.320517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1567ad-c363-4b4e-a8c8-9dc2f6ca3302 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:01.331749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1567ad-c363-4b4e-a8c8-9dc2f6ca3302 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:01.339196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:01.339882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:01.340155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:01.340433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] PATH_INFO: `/v3/projects/9ac8c2cef08845d28420d370849fe553/users/7d67ff6939664dbf8e35155f2afea9a1/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:01.342700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac8c2cef08845d28420d370849fe553, user_id=7d67ff6939664dbf8e35155f2afea9a1, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:01.346376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:01.358820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1197/2401] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:01 2022] PUT /identity/v3/projects/9ac8c2cef08845d28420d370849fe553/users/7d67ff6939664dbf8e35155f2afea9a1/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:01.371334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033473-0c94-49ad-9a88-37c7cf0fd923 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:01.371623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033473-0c94-49ad-9a88-37c7cf0fd923 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:01.371903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033473-0c94-49ad-9a88-37c7cf0fd923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:01.406534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-31033473-0c94-49ad-9a88-37c7cf0fd923 None None] MFA Rules not processed for user `7d67ff6939664dbf8e35155f2afea9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:01.407855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-31033473-0c94-49ad-9a88-37c7cf0fd923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:01.447763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:01.490458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1205/2402] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:01.505248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:01.506640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:01.572042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d87a4-e55b-4269-a560-690415b83e64 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:01.575900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27551115-e549-4b06-8048-e5e1ae746f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:01.576516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27551115-e549-4b06-8048-e5e1ae746f49 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:01.576796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27551115-e549-4b06-8048-e5e1ae746f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:01.577097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27551115-e549-4b06-8048-e5e1ae746f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:01.587478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27551115-e549-4b06-8048-e5e1ae746f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:01.589869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27551115-e549-4b06-8048-e5e1ae746f49 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:01.600252 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1198/2403] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:02.146494 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31033473-0c94-49ad-9a88-37c7cf0fd923 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:02.156765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31033473-0c94-49ad-9a88-37c7cf0fd923 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:02.161381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:02.162105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:02.162385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:02.162661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:02.223754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:02.225227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:02.234278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1206/2404] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:05.939113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27551115-e549-4b06-8048-e5e1ae746f49 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:06.035595 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27551115-e549-4b06-8048-e5e1ae746f49 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:06.046981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:06.048051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:06.048418 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:06.048742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] PATH_INFO: `/v3/users/5c7a723ee3cb427b873a1eee1278f422` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:06.052870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:06.053322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7a723ee3cb427b873a1eee1278f422)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:06.053438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:06.054645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:06.122979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7a8a-ca32-4417-b184-df721e35d9ad service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:06.126615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85199f-8f64-4891-86ef-c7e7773091a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:06.127229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85199f-8f64-4891-86ef-c7e7773091a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:06.127508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85199f-8f64-4891-86ef-c7e7773091a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:06.127803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85199f-8f64-4891-86ef-c7e7773091a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:06.130189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bc85199f-8f64-4891-86ef-c7e7773091a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:06.142571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85199f-8f64-4891-86ef-c7e7773091a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:06.144011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85199f-8f64-4891-86ef-c7e7773091a5 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:06.154875 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1207/2405] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:06.234895 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7a723ee3cb427b873a1eee1278f422'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:06.236048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7a723ee3cb427b873a1eee1278f422'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:06.236676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7a723ee3cb427b873a1eee1278f422'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:06.250589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7a723ee3cb427b873a1eee1278f422'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:06.255052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:06.322088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7a723ee3cb427b873a1eee1278f422'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:06.336907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1199/2406] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:05 2022] DELETE /identity/v3/users/5c7a723ee3cb427b873a1eee1278f422 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:06.342932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdf37-c46a-4676-80aa-594c7be0ad2c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:06.343303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdf37-c46a-4676-80aa-594c7be0ad2c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:06.343586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cdf37-c46a-4676-80aa-594c7be0ad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:06.364455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c17cdf37-c46a-4676-80aa-594c7be0ad2c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:06.368149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c17cdf37-c46a-4676-80aa-594c7be0ad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:06.430927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1208/2407] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:06.440997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:06.443348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:06.510203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5513ae-2dc0-424e-81bb-296b5a8e85c6 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:06.513987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad677b-d552-4522-ad51-1a53708cf467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:06.514659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad677b-d552-4522-ad51-1a53708cf467 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:06.514942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad677b-d552-4522-ad51-1a53708cf467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:06.515220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad677b-d552-4522-ad51-1a53708cf467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:06.525389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad677b-d552-4522-ad51-1a53708cf467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:06.526827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad677b-d552-4522-ad51-1a53708cf467 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:06.536944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1200/2408] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:07.088247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cdf37-c46a-4676-80aa-594c7be0ad2c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:07.090359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c17cdf37-c46a-4676-80aa-594c7be0ad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:07.106049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cdf37-c46a-4676-80aa-594c7be0ad2c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:07.111606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:07.112254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:07.112767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:07.113099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] PATH_INFO: `/v3/projects/43f5e632531a416f8375ad8b22d7283b` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:07.114278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f5e632531a416f8375ad8b22d7283b)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:07.117548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:07.126834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:07.257972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f5e632531a416f8375ad8b22d7283b', 'request_id': 'req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.265025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f5e632531a416f8375ad8b22d7283b', 'request_id': 'req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.387203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f5e632531a416f8375ad8b22d7283b', 'request_id': 'req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.402760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] The token cache is being invalidate because project 43f5e632531a416f8375ad8b22d7283b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:07.402952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.404763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.406934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1209/2409] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:07 2022] DELETE /identity/v3/projects/43f5e632531a416f8375ad8b22d7283b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:07.411301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad677b-d552-4522-ad51-1a53708cf467 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:07.422187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad677b-d552-4522-ad51-1a53708cf467 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:07.484911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:07.486751 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:07.487304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:07.487614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] PATH_INFO: `/v3/users/7d67ff6939664dbf8e35155f2afea9a1` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:07.493367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d67ff6939664dbf8e35155f2afea9a1)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:07.495567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:07.765740 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d67ff6939664dbf8e35155f2afea9a1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.766421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d67ff6939664dbf8e35155f2afea9a1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.767036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d67ff6939664dbf8e35155f2afea9a1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.785986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d67ff6939664dbf8e35155f2afea9a1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.888919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-44f1ef98-b5a9-4193-981f-09f50d00deaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d67ff6939664dbf8e35155f2afea9a1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:07.909381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1201/2410] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:07 2022] DELETE /identity/v3/users/7d67ff6939664dbf8e35155f2afea9a1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:08.537336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:08.538956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:08.552840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f47c52-8b3f-42c0-8131-c7ba79dce45e admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:08.614851 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:08.615505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:08.615789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:08.616064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] PATH_INFO: `/v3/projects/9ac8c2cef08845d28420d370849fe553` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:08.617294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac8c2cef08845d28420d370849fe553)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:08.619214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:08.740341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac8c2cef08845d28420d370849fe553', 'request_id': 'req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:08.750470 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac8c2cef08845d28420d370849fe553', 'request_id': 'req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:08.834277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac8c2cef08845d28420d370849fe553', 'request_id': 'req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:08.847724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] The token cache is being invalidate because project 9ac8c2cef08845d28420d370849fe553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:08.848294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:08.848818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-8c5bc9f8-0f38-4673-bdfc-0b7ef92ed8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:08.850394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1210/2411] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:08 2022] DELETE /identity/v3/projects/9ac8c2cef08845d28420d370849fe553 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:08.855498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e942-d220-4669-bd74-65f943f7ae8b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:08.856044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e942-d220-4669-bd74-65f943f7ae8b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:08.856044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e942-d220-4669-bd74-65f943f7ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:08.878514 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-8a89e942-d220-4669-bd74-65f943f7ae8b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:08.880783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8a89e942-d220-4669-bd74-65f943f7ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:08.884954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:08.949188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1202/2412] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:08.962460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a60408-98a8-4597-8224-ccc92372be28 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:08.962460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a60408-98a8-4597-8224-ccc92372be28 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:08.962460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a60408-98a8-4597-8224-ccc92372be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:08.981436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-89a60408-98a8-4597-8224-ccc92372be28 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:08.982667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-89a60408-98a8-4597-8224-ccc92372be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:09.012922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1211/2413] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:09.019972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89e942-d220-4669-bd74-65f943f7ae8b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:09.042162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89e942-d220-4669-bd74-65f943f7ae8b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:09.054538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:09.055381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:09.057245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:09.057601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:09.058408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:09.058787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:09.060511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:09.076311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1203/2414] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:09.081257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a60408-98a8-4597-8224-ccc92372be28 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:09.092777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a60408-98a8-4597-8224-ccc92372be28 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:09.098014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a880af-07e7-44fd-a110-9d8e39cdde50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:09.098774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a880af-07e7-44fd-a110-9d8e39cdde50 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:09.105094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a880af-07e7-44fd-a110-9d8e39cdde50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:09.105094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a880af-07e7-44fd-a110-9d8e39cdde50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:09.105094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a880af-07e7-44fd-a110-9d8e39cdde50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:09.105094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a880af-07e7-44fd-a110-9d8e39cdde50 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:09.121529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:09.217985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1212/2415] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:09 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:09.223151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:09.237608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e59ec-005c-448d-9770-b9e880a35897 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:09.321384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c667-2a35-4ac8-af5f-b1b2b390ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:09.322724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c667-2a35-4ac8-af5f-b1b2b390ecca admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:09.323134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c667-2a35-4ac8-af5f-b1b2b390ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:09.323621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c667-2a35-4ac8-af5f-b1b2b390ecca admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:09.324646 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42c667-2a35-4ac8-af5f-b1b2b390ecca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:09.326772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42c667-2a35-4ac8-af5f-b1b2b390ecca admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:09.425230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1204/2416] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:09 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:09.429814 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a880af-07e7-44fd-a110-9d8e39cdde50 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:09.442768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a880af-07e7-44fd-a110-9d8e39cdde50 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:09.448916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3e501-a06e-49a4-ad9c-548b35af8950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:09.449779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3e501-a06e-49a4-ad9c-548b35af8950 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:09.450069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3e501-a06e-49a4-ad9c-548b35af8950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:09.450346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3e501-a06e-49a4-ad9c-548b35af8950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:09.452954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3e501-a06e-49a4-ad9c-548b35af8950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:09.453083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3e501-a06e-49a4-ad9c-548b35af8950 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:09.467460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1213/2417] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:09.477907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c667-2a35-4ac8-af5f-b1b2b390ecca admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:09.490448 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c667-2a35-4ac8-af5f-b1b2b390ecca admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:09.497093 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc108-74f1-4fd7-b87f-ce4ffeb531e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:09.498066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc108-74f1-4fd7-b87f-ce4ffeb531e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:09.498551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc108-74f1-4fd7-b87f-ce4ffeb531e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:09.510497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc108-74f1-4fd7-b87f-ce4ffeb531e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:09.510497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fc108-74f1-4fd7-b87f-ce4ffeb531e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:09.510497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fc108-74f1-4fd7-b87f-ce4ffeb531e2 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:09.523714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1205/2418] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:09.527938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3e501-a06e-49a4-ad9c-548b35af8950 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:09.540522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3e501-a06e-49a4-ad9c-548b35af8950 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:09.545343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44293d-0fca-4216-9664-4151bb234186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:09.546006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44293d-0fca-4216-9664-4151bb234186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:09.546283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44293d-0fca-4216-9664-4151bb234186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:09.546554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44293d-0fca-4216-9664-4151bb234186 admin admin] PATH_INFO: `/v3/projects/a6cf726177754338bb4e0ec7ba0a6261/users/ac18ec901c804f8c9c5b2ff9dc360f96/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:09.562754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44293d-0fca-4216-9664-4151bb234186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf726177754338bb4e0ec7ba0a6261, user_id=ac18ec901c804f8c9c5b2ff9dc360f96, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:09.566032 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44293d-0fca-4216-9664-4151bb234186 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:09.660191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1214/2419] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:09 2022] PUT /identity/v3/projects/a6cf726177754338bb4e0ec7ba0a6261/users/ac18ec901c804f8c9c5b2ff9dc360f96/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:09.671767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2178-93aa-4f2d-a136-3f148ebffc54 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:09.672072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2178-93aa-4f2d-a136-3f148ebffc54 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:09.672708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2178-93aa-4f2d-a136-3f148ebffc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:09.725587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a5dd2178-93aa-4f2d-a136-3f148ebffc54 None None] MFA Rules not processed for user `ac18ec901c804f8c9c5b2ff9dc360f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:09.726913 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a5dd2178-93aa-4f2d-a136-3f148ebffc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:09.825128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1206/2420] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:09.828247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44293d-0fca-4216-9664-4151bb234186 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:09.910781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44293d-0fca-4216-9664-4151bb234186 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:09.917283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda63fb-ae78-475c-9119-edc9227382c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:09.917917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda63fb-ae78-475c-9119-edc9227382c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:09.918188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda63fb-ae78-475c-9119-edc9227382c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:09.918457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda63fb-ae78-475c-9119-edc9227382c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:09.919148 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda63fb-ae78-475c-9119-edc9227382c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:09.921817 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda63fb-ae78-475c-9119-edc9227382c6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.049291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1215/2421] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:09 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:10.054182 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2178-93aa-4f2d-a136-3f148ebffc54 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:10.061811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:10.067413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2178-93aa-4f2d-a136-3f148ebffc54 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:10.130822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a9dee-b790-49b1-9d68-8cfa0f4f0988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:10.131457 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a9dee-b790-49b1-9d68-8cfa0f4f0988 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.131734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a9dee-b790-49b1-9d68-8cfa0f4f0988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.132099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a9dee-b790-49b1-9d68-8cfa0f4f0988 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.132788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a9dee-b790-49b1-9d68-8cfa0f4f0988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:10.134972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a9dee-b790-49b1-9d68-8cfa0f4f0988 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.250118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1207/2422] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:10 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:10.254826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda63fb-ae78-475c-9119-edc9227382c6 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:10.265524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda63fb-ae78-475c-9119-edc9227382c6 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:10.270299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:10.271538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.271538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.271764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.272601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:10.274336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.293238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1216/2423] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:10.294498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a9dee-b790-49b1-9d68-8cfa0f4f0988 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:10.306237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a9dee-b790-49b1-9d68-8cfa0f4f0988 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:10.310724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:10.311518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f42d4-a8df-4113-894a-1ce91f09e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:10.312247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f42d4-a8df-4113-894a-1ce91f09e542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.312463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:10.312692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f42d4-a8df-4113-894a-1ce91f09e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.313002 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f42d4-a8df-4113-894a-1ce91f09e542 admin admin] PATH_INFO: `/v3/projects/5954907b48274311923967ccfed1ff42/users/ee6bcff6077542529a92586f7d993cc0/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.330208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f42d4-a8df-4113-894a-1ce91f09e542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5954907b48274311923967ccfed1ff42, user_id=ee6bcff6077542529a92586f7d993cc0, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:10.334162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f42d4-a8df-4113-894a-1ce91f09e542 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.388034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302404-bb72-4fc3-9933-9d9e76dff749 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:10.393409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:10.394061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.394406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.394888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.396936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:10.408471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:10.411240 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.414443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1208/2424] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:10 2022] PUT /identity/v3/projects/5954907b48274311923967ccfed1ff42/users/ee6bcff6077542529a92586f7d993cc0/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:10.418601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f42d4-a8df-4113-894a-1ce91f09e542 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:10.424942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1217/2425] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:10.478373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:10.480686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:10.484436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f42d4-a8df-4113-894a-1ce91f09e542 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:10.491666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee4b66-41cf-43a4-b8d7-b5db2b87fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:10.492243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4b66-41cf-43a4-b8d7-b5db2b87fece admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.492517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4b66-41cf-43a4-b8d7-b5db2b87fece admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.492786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4b66-41cf-43a4-b8d7-b5db2b87fece admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.493520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee4b66-41cf-43a4-b8d7-b5db2b87fece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:10.495154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee4b66-41cf-43a4-b8d7-b5db2b87fece admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.507122 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92faa9-91ab-4574-b187-8d36120c5831 service placement] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:10.507493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1209/2426] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:10.511216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee4b66-41cf-43a4-b8d7-b5db2b87fece admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:10.513167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:10.513834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.514865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.514865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] PATH_INFO: `/v3/users/793d3d46e32b4550b711841f2447461a` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.515865 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=793d3d46e32b4550b711841f2447461a)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:10.517943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.521941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee4b66-41cf-43a4-b8d7-b5db2b87fece admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:10.527021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda637a3-5584-45a3-889c-6d0891459254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:10.527671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda637a3-5584-45a3-889c-6d0891459254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.527949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda637a3-5584-45a3-889c-6d0891459254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.528220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda637a3-5584-45a3-889c-6d0891459254 admin admin] PATH_INFO: `/v3/projects/5954907b48274311923967ccfed1ff42/users/ee6bcff6077542529a92586f7d993cc0/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.530192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda637a3-5584-45a3-889c-6d0891459254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5954907b48274311923967ccfed1ff42, user_id=ee6bcff6077542529a92586f7d993cc0, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:10.533102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda637a3-5584-45a3-889c-6d0891459254 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.541699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:10.544606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1210/2427] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:10 2022] PUT /identity/v3/projects/5954907b48274311923967ccfed1ff42/users/ee6bcff6077542529a92586f7d993cc0/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:10.556891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0c4a-0c15-4eef-9b59-7ed56473f12c None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.557197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0c4a-0c15-4eef-9b59-7ed56473f12c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.557474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0c4a-0c15-4eef-9b59-7ed56473f12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.585403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c07e0c4a-0c15-4eef-9b59-7ed56473f12c None None] MFA Rules not processed for user `ee6bcff6077542529a92586f7d993cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:10.586628 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c07e0c4a-0c15-4eef-9b59-7ed56473f12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:10.655506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1211/2428] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:10.667861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e0c4a-0c15-4eef-9b59-7ed56473f12c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:10.669236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c07e0c4a-0c15-4eef-9b59-7ed56473f12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:10.726321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e0c4a-0c15-4eef-9b59-7ed56473f12c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:10.726539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793d3d46e32b4550b711841f2447461a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:10.730570 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20119a57-c63d-492a-aded-e73d37d816b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:10.731361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20119a57-c63d-492a-aded-e73d37d816b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:10.731716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20119a57-c63d-492a-aded-e73d37d816b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:10.732046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20119a57-c63d-492a-aded-e73d37d816b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:10.733541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793d3d46e32b4550b711841f2447461a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:10.794566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20119a57-c63d-492a-aded-e73d37d816b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:10.796025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20119a57-c63d-492a-aded-e73d37d816b3 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:10.811340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1212/2429] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:10.842197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793d3d46e32b4550b711841f2447461a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:10.864491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793d3d46e32b4550b711841f2447461a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:10.865236 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b419ffbf-d134-4862-973e-160389ea5a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793d3d46e32b4550b711841f2447461a'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:10.873760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1218/2430] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:10 2022] DELETE /identity/v3/users/793d3d46e32b4550b711841f2447461a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:10.876707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:11.163559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20119a57-c63d-492a-aded-e73d37d816b3 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:11.241932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20119a57-c63d-492a-aded-e73d37d816b3 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:11.300874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:11.301571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:11.301850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:11.302125 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] PATH_INFO: `/v3/projects/064dd468bc554ddb9507c49e62e2a2bf` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:11.303334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=064dd468bc554ddb9507c49e62e2a2bf)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:11.305273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:11.422215 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064dd468bc554ddb9507c49e62e2a2bf', 'request_id': 'req-051378a8-01f9-40dc-80bd-5c768b34a25c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:11.428989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064dd468bc554ddb9507c49e62e2a2bf', 'request_id': 'req-051378a8-01f9-40dc-80bd-5c768b34a25c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:11.534937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064dd468bc554ddb9507c49e62e2a2bf', 'request_id': 'req-051378a8-01f9-40dc-80bd-5c768b34a25c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:11.546884 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] The token cache is being invalidate because project 064dd468bc554ddb9507c49e62e2a2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:11.547180 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:11.547830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-051378a8-01f9-40dc-80bd-5c768b34a25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:11.549384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1213/2431] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:11 2022] DELETE /identity/v3/projects/064dd468bc554ddb9507c49e62e2a2bf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:11.555196 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034827e-4ca9-43f4-a27e-c0a6f338ba44 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:11.556015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034827e-4ca9-43f4-a27e-c0a6f338ba44 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:11.556545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034827e-4ca9-43f4-a27e-c0a6f338ba44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:11.577150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c034827e-4ca9-43f4-a27e-c0a6f338ba44 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:11.578386 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c034827e-4ca9-43f4-a27e-c0a6f338ba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:11.640661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1219/2432] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:11.649860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347d19b-33bd-4578-a399-ef55dde3f4b2 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:11.650169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347d19b-33bd-4578-a399-ef55dde3f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:11.650464 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347d19b-33bd-4578-a399-ef55dde3f4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:11.670955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-1347d19b-33bd-4578-a399-ef55dde3f4b2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:11.676110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1347d19b-33bd-4578-a399-ef55dde3f4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:11.682364 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1214/2433] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:11.686933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034827e-4ca9-43f4-a27e-c0a6f338ba44 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:11.697666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034827e-4ca9-43f4-a27e-c0a6f338ba44 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:11.702922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:11.703540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:11.703815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:11.704149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:11.704853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:11.705184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:11.713355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:11.718854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1220/2434] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:11.723551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347d19b-33bd-4578-a399-ef55dde3f4b2 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:11.732808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347d19b-33bd-4578-a399-ef55dde3f4b2 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:11.737437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f69505-825c-4721-b26c-3e2c473d17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:11.738855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f69505-825c-4721-b26c-3e2c473d17d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:11.739139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f69505-825c-4721-b26c-3e2c473d17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:11.739467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f69505-825c-4721-b26c-3e2c473d17d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:11.740088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f69505-825c-4721-b26c-3e2c473d17d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:11.742061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f69505-825c-4721-b26c-3e2c473d17d3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:11.823040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:11.830281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1215/2435] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:11 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:11.835010 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:11.845175 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a42f13-a828-4499-ad71-5d2b2eb02b97 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:11.901199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1fcd-2dcd-41dc-9f5b-639a73ddaa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:11.901864 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1fcd-2dcd-41dc-9f5b-639a73ddaa58 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:11.902149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1fcd-2dcd-41dc-9f5b-639a73ddaa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:11.902416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1fcd-2dcd-41dc-9f5b-639a73ddaa58 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:11.903077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1fcd-2dcd-41dc-9f5b-639a73ddaa58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:11.905047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1fcd-2dcd-41dc-9f5b-639a73ddaa58 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:12.043736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1221/2436] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:11 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:12.047875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f69505-825c-4721-b26c-3e2c473d17d3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:12.059433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f69505-825c-4721-b26c-3e2c473d17d3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:12.063941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d0e3-2e22-49e5-a271-9ac628930c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:12.064548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d0e3-2e22-49e5-a271-9ac628930c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:12.064906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d0e3-2e22-49e5-a271-9ac628930c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:12.065163 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d0e3-2e22-49e5-a271-9ac628930c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:12.065851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8d0e3-2e22-49e5-a271-9ac628930c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:12.067532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8d0e3-2e22-49e5-a271-9ac628930c04 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:12.077953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1216/2437] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:12.082014 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1fcd-2dcd-41dc-9f5b-639a73ddaa58 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:12.091989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1fcd-2dcd-41dc-9f5b-639a73ddaa58 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:12.096561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924e3b6-f04f-47bb-b7f3-1130b4cac5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:12.097210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924e3b6-f04f-47bb-b7f3-1130b4cac5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:12.098054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924e3b6-f04f-47bb-b7f3-1130b4cac5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:12.098393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924e3b6-f04f-47bb-b7f3-1130b4cac5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:12.099107 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924e3b6-f04f-47bb-b7f3-1130b4cac5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:12.100710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924e3b6-f04f-47bb-b7f3-1130b4cac5bb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:12.111359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1222/2438] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:12.116260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d0e3-2e22-49e5-a271-9ac628930c04 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:12.127171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d0e3-2e22-49e5-a271-9ac628930c04 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:12.132121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:12.132769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:12.137429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:12.137429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] PATH_INFO: `/v3/projects/c99e2d574da54ae0a6cc5a204c2a71d4/users/97d2a4d81e51447cb939574e501d3ac1/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:12.148591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99e2d574da54ae0a6cc5a204c2a71d4, user_id=97d2a4d81e51447cb939574e501d3ac1, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:12.151321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:12.256190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1217/2439] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:12 2022] PUT /identity/v3/projects/c99e2d574da54ae0a6cc5a204c2a71d4/users/97d2a4d81e51447cb939574e501d3ac1/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:12.266497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966ea1c-8ff9-47cc-8400-eed39d3eea59 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:12.266811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966ea1c-8ff9-47cc-8400-eed39d3eea59 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:12.267087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966ea1c-8ff9-47cc-8400-eed39d3eea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:12.275550 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:12.297214 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b966ea1c-8ff9-47cc-8400-eed39d3eea59 None None] MFA Rules not processed for user `97d2a4d81e51447cb939574e501d3ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:12.298471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b966ea1c-8ff9-47cc-8400-eed39d3eea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:12.362556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1223/2440] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:12.373275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:12.375545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:12.451366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:12.455719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c7453-22e0-4e79-a94c-468ee69d2f57 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:12.463348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:12.463966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:12.464241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:12.464507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:12.473325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:12.474963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:12.484842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1218/2441] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:14.631979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966ea1c-8ff9-47cc-8400-eed39d3eea59 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:14.632593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:14.633518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b966ea1c-8ff9-47cc-8400-eed39d3eea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:14.633979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:14.715249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634794-8064-43b8-ae00-80620b3c6f17 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:14.719278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302bd8-9102-4ca2-a108-8b411dbbbcb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:14.719909 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302bd8-9102-4ca2-a108-8b411dbbbcb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:14.720186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302bd8-9102-4ca2-a108-8b411dbbbcb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:14.720582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302bd8-9102-4ca2-a108-8b411dbbbcb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:14.723824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-72302bd8-9102-4ca2-a108-8b411dbbbcb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:14.726918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966ea1c-8ff9-47cc-8400-eed39d3eea59 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:14.742419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:14.743747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:14.743747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:14.743747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] PATH_INFO: `/v3/users/96cab1ab9bb94cecac4eb9373116f111` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:14.745525 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96cab1ab9bb94cecac4eb9373116f111)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:14.747957 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:14.795063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72302bd8-9102-4ca2-a108-8b411dbbbcb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:14.796511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72302bd8-9102-4ca2-a108-8b411dbbbcb8 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:14.808567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1219/2442] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:14.955936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96cab1ab9bb94cecac4eb9373116f111'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:14.964683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96cab1ab9bb94cecac4eb9373116f111'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.038307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96cab1ab9bb94cecac4eb9373116f111'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.052491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96cab1ab9bb94cecac4eb9373116f111'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.053103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96cab1ab9bb94cecac4eb9373116f111'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.059049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1224/2443] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:14 2022] DELETE /identity/v3/users/96cab1ab9bb94cecac4eb9373116f111 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:15.063669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072ae07-1d25-4678-95b4-e8891171dcbd None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:15.063959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072ae07-1d25-4678-95b4-e8891171dcbd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:15.064238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072ae07-1d25-4678-95b4-e8891171dcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:15.083492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9072ae07-1d25-4678-95b4-e8891171dcbd None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:15.084711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9072ae07-1d25-4678-95b4-e8891171dcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:15.150261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1220/2444] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:15.160763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:15.162652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:15.178493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:15.224951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8877ff0-5b44-4f3c-86de-371182426584 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:15.228591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:15.229265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:15.229549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:15.229825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:15.239456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:15.240943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:15.251319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1225/2445] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:15.729853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072ae07-1d25-4678-95b4-e8891171dcbd None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:15.731369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9072ae07-1d25-4678-95b4-e8891171dcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:15.744970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072ae07-1d25-4678-95b4-e8891171dcbd None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:15.750729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:15.751390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:15.751677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:15.751930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] PATH_INFO: `/v3/projects/7202a6c5fa9642c8a15c24ff9feb2275` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:15.753213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7202a6c5fa9642c8a15c24ff9feb2275)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:15.756185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:15.793432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:15.794915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:15.812701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bf328-a953-4bf3-8c76-ec557ad856e5 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:15.813802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:15.814434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:15.814720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:15.815005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] PATH_INFO: `/v3/users/97d2a4d81e51447cb939574e501d3ac1` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:15.816164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d2a4d81e51447cb939574e501d3ac1)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:15.818319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:15.871456 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:15.880310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7202a6c5fa9642c8a15c24ff9feb2275', 'request_id': 'req-39062c58-928d-4c63-aecf-163bf2f73f2d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.885780 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7202a6c5fa9642c8a15c24ff9feb2275', 'request_id': 'req-39062c58-928d-4c63-aecf-163bf2f73f2d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.979268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7202a6c5fa9642c8a15c24ff9feb2275', 'request_id': 'req-39062c58-928d-4c63-aecf-163bf2f73f2d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.991449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] The token cache is being invalidate because project 7202a6c5fa9642c8a15c24ff9feb2275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:15.991731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.992349 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:15.993886 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1221/2446] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:15 2022] DELETE /identity/v3/projects/7202a6c5fa9642c8a15c24ff9feb2275 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:15.998090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:15.999425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:16.022803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d2a4d81e51447cb939574e501d3ac1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.030093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d2a4d81e51447cb939574e501d3ac1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.065094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062c58-928d-4c63-aecf-163bf2f73f2d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:16.069999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:16.070625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:16.070935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:16.076096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] PATH_INFO: `/v3/users/dc9295dc67d34008ae0977f67725bf13` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:16.076096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9295dc67d34008ae0977f67725bf13)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:16.076096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:16.129105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d2a4d81e51447cb939574e501d3ac1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.141584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d2a4d81e51447cb939574e501d3ac1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.142233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-febc58ef-de2c-4954-9392-05b4b3c19800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d2a4d81e51447cb939574e501d3ac1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.149291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1226/2447] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:15 2022] DELETE /identity/v3/users/97d2a4d81e51447cb939574e501d3ac1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:16.153765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdf3d-026e-429f-b305-7e1a88b6dca9 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:16.154056 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdf3d-026e-429f-b305-7e1a88b6dca9 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:16.154333 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdf3d-026e-429f-b305-7e1a88b6dca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:16.174070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f1efdf3d-026e-429f-b305-7e1a88b6dca9 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:16.175279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f1efdf3d-026e-429f-b305-7e1a88b6dca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:16.234786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1227/2448] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:16.245382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efdf3d-026e-429f-b305-7e1a88b6dca9 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:16.246738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f1efdf3d-026e-429f-b305-7e1a88b6dca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:16.276830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9295dc67d34008ae0977f67725bf13'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.277634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9295dc67d34008ae0977f67725bf13'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.278274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9295dc67d34008ae0977f67725bf13'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.279190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:16.291305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9295dc67d34008ae0977f67725bf13'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.307638 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efdf3d-026e-429f-b305-7e1a88b6dca9 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:16.311369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:16.311986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:16.312267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:16.312541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:16.314423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:16.326779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:16.328146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:16.338434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1228/2449] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:16.378996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9295dc67d34008ae0977f67725bf13'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.392351 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1222/2450] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:15 2022] DELETE /identity/v3/users/dc9295dc67d34008ae0977f67725bf13 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:16.783252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:16.785839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:16.803704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332970-90a7-4ce9-951e-ad8520a59f73 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:16.866142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:16.866720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:16.866985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:16.867259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] PATH_INFO: `/v3/projects/c99e2d574da54ae0a6cc5a204c2a71d4` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:16.868513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99e2d574da54ae0a6cc5a204c2a71d4)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:16.870604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:16.886392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:16.886392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:16.901241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7366f-90aa-4c78-85a7-d08a19187d94 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:16.905908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:16.906544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:16.907001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:16.907278 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] PATH_INFO: `/v3/projects/31737c9f327349fbbb2c3d4ba93d0079` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:16.909642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31737c9f327349fbbb2c3d4ba93d0079)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:16.915007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:16.981601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99e2d574da54ae0a6cc5a204c2a71d4', 'request_id': 'req-43fab9e1-3689-4c3e-9804-04a9b5f98154'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:16.987000 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99e2d574da54ae0a6cc5a204c2a71d4', 'request_id': 'req-43fab9e1-3689-4c3e-9804-04a9b5f98154'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.026376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:17.033232 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31737c9f327349fbbb2c3d4ba93d0079', 'request_id': 'req-58118806-767f-4a3b-8361-c91cca5f07f7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.038963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31737c9f327349fbbb2c3d4ba93d0079', 'request_id': 'req-58118806-767f-4a3b-8361-c91cca5f07f7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.060491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99e2d574da54ae0a6cc5a204c2a71d4', 'request_id': 'req-43fab9e1-3689-4c3e-9804-04a9b5f98154'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.073561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] The token cache is being invalidate because project c99e2d574da54ae0a6cc5a204c2a71d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:17.073857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.074546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-43fab9e1-3689-4c3e-9804-04a9b5f98154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.076210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1229/2451] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:16 2022] DELETE /identity/v3/projects/c99e2d574da54ae0a6cc5a204c2a71d4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:17.080850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee435ee-e21c-48a0-8070-ee80fb9fa7f1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.081167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee435ee-e21c-48a0-8070-ee80fb9fa7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.081445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee435ee-e21c-48a0-8070-ee80fb9fa7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.101325 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-0ee435ee-e21c-48a0-8070-ee80fb9fa7f1 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:17.102565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0ee435ee-e21c-48a0-8070-ee80fb9fa7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:17.138683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31737c9f327349fbbb2c3d4ba93d0079', 'request_id': 'req-58118806-767f-4a3b-8361-c91cca5f07f7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.151383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] The token cache is being invalidate because project 31737c9f327349fbbb2c3d4ba93d0079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:17.151674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.152332 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-58118806-767f-4a3b-8361-c91cca5f07f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:17.153823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:17.153990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1223/2452] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:16 2022] DELETE /identity/v3/projects/31737c9f327349fbbb2c3d4ba93d0079 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:17.158712 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268656c-8abe-46d0-b91b-779adf4d7323 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.158993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268656c-8abe-46d0-b91b-779adf4d7323 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.159268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268656c-8abe-46d0-b91b-779adf4d7323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.169090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1230/2453] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:17.171069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e30ca-bccb-43ba-84f0-dbdcad59214f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.171384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e30ca-bccb-43ba-84f0-dbdcad59214f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.171711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e30ca-bccb-43ba-84f0-dbdcad59214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.180675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b268656c-8abe-46d0-b91b-779adf4d7323 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:17.185346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b268656c-8abe-46d0-b91b-779adf4d7323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:17.189951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1224/2454] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:17.191771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1d8e30ca-bccb-43ba-84f0-dbdcad59214f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:17.193016 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1d8e30ca-bccb-43ba-84f0-dbdcad59214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:17.198897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502e656-30fd-43fd-9b7a-765512dc8d2d None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.199187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502e656-30fd-43fd-9b7a-765512dc8d2d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.199462 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502e656-30fd-43fd-9b7a-765512dc8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.201186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1231/2455] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:17.205149 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e30ca-bccb-43ba-84f0-dbdcad59214f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.214839 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e30ca-bccb-43ba-84f0-dbdcad59214f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.219717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.220538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.220680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.220908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.221617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:17.221924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.223900 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-2502e656-30fd-43fd-9b7a-765512dc8d2d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:17.224094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.225214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2502e656-30fd-43fd-9b7a-765512dc8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:17.233656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1225/2456] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:17.236111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1232/2457] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:31:17.242080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502e656-30fd-43fd-9b7a-765512dc8d2d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.243278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.256390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502e656-30fd-43fd-9b7a-765512dc8d2d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.260406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44252867-d91d-448d-a09b-ff41b71e9f1b admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.263263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.264229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.264691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.265196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.266361 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:17.266872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.267549 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9964f42-abb5-4542-aef9-12b750b150b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.268741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9964f42-abb5-4542-aef9-12b750b150b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.269226 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9964f42-abb5-4542-aef9-12b750b150b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.269826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.269954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9964f42-abb5-4542-aef9-12b750b150b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.270900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9964f42-abb5-4542-aef9-12b750b150b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.274265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9964f42-abb5-4542-aef9-12b750b150b4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.289584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1226/2458] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:17.294467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.306200 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d67eb-5a7c-4014-abad-a7bb133efd05 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.310827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef633-b6e6-4bbd-9bd9-c7006e5320e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.311420 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef633-b6e6-4bbd-9bd9-c7006e5320e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.311719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef633-b6e6-4bbd-9bd9-c7006e5320e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.311987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ef633-b6e6-4bbd-9bd9-c7006e5320e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.312661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ef633-b6e6-4bbd-9bd9-c7006e5320e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.314614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ef633-b6e6-4bbd-9bd9-c7006e5320e0 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.380567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1233/2459] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:17.384735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9964f42-abb5-4542-aef9-12b750b150b4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.410871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1227/2460] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:17.414503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef633-b6e6-4bbd-9bd9-c7006e5320e0 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.452552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9964f42-abb5-4542-aef9-12b750b150b4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.481345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ef633-b6e6-4bbd-9bd9-c7006e5320e0 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.486145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587f7d-b8b9-4310-8f4a-41be5b6de543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.486763 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587f7d-b8b9-4310-8f4a-41be5b6de543 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.487045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587f7d-b8b9-4310-8f4a-41be5b6de543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.487318 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587f7d-b8b9-4310-8f4a-41be5b6de543 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.487975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587f7d-b8b9-4310-8f4a-41be5b6de543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.489980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587f7d-b8b9-4310-8f4a-41be5b6de543 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.515283 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d41d0-a729-4998-acff-8231c70c3594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.515904 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d41d0-a729-4998-acff-8231c70c3594 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.516190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d41d0-a729-4998-acff-8231c70c3594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.516463 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d41d0-a729-4998-acff-8231c70c3594 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.517155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d41d0-a729-4998-acff-8231c70c3594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.519110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d41d0-a729-4998-acff-8231c70c3594 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.768323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1228/2461] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/users => generated 289 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:17.773632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587f7d-b8b9-4310-8f4a-41be5b6de543 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.783528 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587f7d-b8b9-4310-8f4a-41be5b6de543 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.789117 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b161f9-ab0b-4910-b69d-71e163d28cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.789725 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b161f9-ab0b-4910-b69d-71e163d28cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.790007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b161f9-ab0b-4910-b69d-71e163d28cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.790283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b161f9-ab0b-4910-b69d-71e163d28cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.790975 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b161f9-ab0b-4910-b69d-71e163d28cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.792567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b161f9-ab0b-4910-b69d-71e163d28cd3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.804026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1229/2462] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:17.808858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b161f9-ab0b-4910-b69d-71e163d28cd3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.809878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1234/2463] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/users => generated 282 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:17.813658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d41d0-a729-4998-acff-8231c70c3594 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.820086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b161f9-ab0b-4910-b69d-71e163d28cd3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.824328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d41d0-a729-4998-acff-8231c70c3594 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.824771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6d815-c4af-4e06-a1e8-1f4f65144840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.825433 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d815-c4af-4e06-a1e8-1f4f65144840 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.825857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d815-c4af-4e06-a1e8-1f4f65144840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.826118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d815-c4af-4e06-a1e8-1f4f65144840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.826807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6d815-c4af-4e06-a1e8-1f4f65144840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.828397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6d815-c4af-4e06-a1e8-1f4f65144840 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.828919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d71e91-f2e9-40c0-8b33-5465c5a04c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.829522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d71e91-f2e9-40c0-8b33-5465c5a04c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.829800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d71e91-f2e9-40c0-8b33-5465c5a04c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.830065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d71e91-f2e9-40c0-8b33-5465c5a04c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.830755 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d71e91-f2e9-40c0-8b33-5465c5a04c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.832753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d71e91-f2e9-40c0-8b33-5465c5a04c60 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.840956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1230/2464] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:17.844393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1235/2465] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:17.844535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6d815-c4af-4e06-a1e8-1f4f65144840 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.846337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d71e91-f2e9-40c0-8b33-5465c5a04c60 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.854670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6d815-c4af-4e06-a1e8-1f4f65144840 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.856455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d71e91-f2e9-40c0-8b33-5465c5a04c60 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.859333 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda47e70-daa7-4481-afee-0596f7d89c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.859990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda47e70-daa7-4481-afee-0596f7d89c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.860264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda47e70-daa7-4481-afee-0596f7d89c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.860534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda47e70-daa7-4481-afee-0596f7d89c3c admin admin] PATH_INFO: `/v3/projects/248ba76891ff4fadaf1feb5c54b67665/users/687ccb2bb9364403b45c80e870f317a1/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.861051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caa659-9e55-4563-a251-ade6ea3f96ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.861651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa659-9e55-4563-a251-ade6ea3f96ba admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.861931 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa659-9e55-4563-a251-ade6ea3f96ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.862204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caa659-9e55-4563-a251-ade6ea3f96ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.863028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caa659-9e55-4563-a251-ade6ea3f96ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.865677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caa659-9e55-4563-a251-ade6ea3f96ba admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.876461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1236/2466] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:17.877294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda47e70-daa7-4481-afee-0596f7d89c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=248ba76891ff4fadaf1feb5c54b67665, user_id=687ccb2bb9364403b45c80e870f317a1, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.880231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda47e70-daa7-4481-afee-0596f7d89c3c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.880585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caa659-9e55-4563-a251-ade6ea3f96ba admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:17.890263 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caa659-9e55-4563-a251-ade6ea3f96ba admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:17.894882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed018117-20eb-4e31-b136-dc656de0a29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:17.895513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed018117-20eb-4e31-b136-dc656de0a29b admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.895795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed018117-20eb-4e31-b136-dc656de0a29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.896327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed018117-20eb-4e31-b136-dc656de0a29b admin admin] PATH_INFO: `/v3/projects/7b59d7ca505c4e198122e95716ffa8a4/users/00b2b6b3f98a40b9876bd6bcffcbddb1/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.910980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed018117-20eb-4e31-b136-dc656de0a29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b59d7ca505c4e198122e95716ffa8a4, user_id=00b2b6b3f98a40b9876bd6bcffcbddb1, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:17.913666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed018117-20eb-4e31-b136-dc656de0a29b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:17.952438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1231/2467] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:17 2022] PUT /identity/v3/projects/248ba76891ff4fadaf1feb5c54b67665/users/687ccb2bb9364403b45c80e870f317a1/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:17.963599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7e645-521c-4ca9-9441-b41299a5af4f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:17.965757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7e645-521c-4ca9-9441-b41299a5af4f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:17.965757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7e645-521c-4ca9-9441-b41299a5af4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:17.994854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1237/2468] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:17 2022] PUT /identity/v3/projects/7b59d7ca505c4e198122e95716ffa8a4/users/00b2b6b3f98a40b9876bd6bcffcbddb1/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:17.995649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6da7e645-521c-4ca9-9441-b41299a5af4f None None] MFA Rules not processed for user `687ccb2bb9364403b45c80e870f317a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:17.996943 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6da7e645-521c-4ca9-9441-b41299a5af4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:18.007169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:18.010871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb5f6-a0a7-4f09-ac9a-bd7d158363d7 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.011156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb5f6-a0a7-4f09-ac9a-bd7d158363d7 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.011441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb5f6-a0a7-4f09-ac9a-bd7d158363d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.037215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:18.046142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-66cfb5f6-a0a7-4f09-ac9a-bd7d158363d7 None None] MFA Rules not processed for user `00b2b6b3f98a40b9876bd6bcffcbddb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:18.047447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-66cfb5f6-a0a7-4f09-ac9a-bd7d158363d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:18.067494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1232/2469] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:18.071855 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7e645-521c-4ca9-9441-b41299a5af4f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.115579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1238/2470] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:18.120001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb5f6-a0a7-4f09-ac9a-bd7d158363d7 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.135321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7e645-521c-4ca9-9441-b41299a5af4f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.139894 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee5e98-c755-46b0-890c-b1958aab2cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.140510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5e98-c755-46b0-890c-b1958aab2cda admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.140782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5e98-c755-46b0-890c-b1958aab2cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.141095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5e98-c755-46b0-890c-b1958aab2cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.145268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee5e98-c755-46b0-890c-b1958aab2cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.147662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee5e98-c755-46b0-890c-b1958aab2cda admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.194130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb5f6-a0a7-4f09-ac9a-bd7d158363d7 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.198824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04183c-2115-4b9b-a64c-f01576c83547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.199444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04183c-2115-4b9b-a64c-f01576c83547 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.199729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04183c-2115-4b9b-a64c-f01576c83547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.200186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04183c-2115-4b9b-a64c-f01576c83547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.200735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04183c-2115-4b9b-a64c-f01576c83547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.202765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04183c-2115-4b9b-a64c-f01576c83547 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.247193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1233/2471] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:18 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:18.248369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee5e98-c755-46b0-890c-b1958aab2cda admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.302453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1239/2472] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:18 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:18.306559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04183c-2115-4b9b-a64c-f01576c83547 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.310922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee5e98-c755-46b0-890c-b1958aab2cda admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.371629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04183c-2115-4b9b-a64c-f01576c83547 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.385566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63926c91-cd6b-4786-8cf3-a572d581122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.385566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63926c91-cd6b-4786-8cf3-a572d581122f admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.385566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63926c91-cd6b-4786-8cf3-a572d581122f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.385566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63926c91-cd6b-4786-8cf3-a572d581122f admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.385995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63926c91-cd6b-4786-8cf3-a572d581122f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.385995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63926c91-cd6b-4786-8cf3-a572d581122f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.386181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d908a-d0fe-4e1c-b70f-6838805c364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.386181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d908a-d0fe-4e1c-b70f-6838805c364d admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.386181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d908a-d0fe-4e1c-b70f-6838805c364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.386181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d908a-d0fe-4e1c-b70f-6838805c364d admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.386546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d908a-d0fe-4e1c-b70f-6838805c364d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.386546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d908a-d0fe-4e1c-b70f-6838805c364d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.474059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1234/2473] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:18 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:18.476638 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1240/2474] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:18 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:18.478101 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63926c91-cd6b-4786-8cf3-a572d581122f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.481418 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d908a-d0fe-4e1c-b70f-6838805c364d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.489099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63926c91-cd6b-4786-8cf3-a572d581122f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.495003 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99280e4-2375-45b4-a9e1-9d642eae98e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.495610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99280e4-2375-45b4-a9e1-9d642eae98e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.495891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99280e4-2375-45b4-a9e1-9d642eae98e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.496165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99280e4-2375-45b4-a9e1-9d642eae98e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.496861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99280e4-2375-45b4-a9e1-9d642eae98e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.498615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99280e4-2375-45b4-a9e1-9d642eae98e3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.503540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d908a-d0fe-4e1c-b70f-6838805c364d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.511268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed9451-97e8-468e-8c25-ff522fadb1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.511268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed9451-97e8-468e-8c25-ff522fadb1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.511268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed9451-97e8-468e-8c25-ff522fadb1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.511268 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed9451-97e8-468e-8c25-ff522fadb1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.512243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed9451-97e8-468e-8c25-ff522fadb1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.513039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed9451-97e8-468e-8c25-ff522fadb1ed admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.515636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1235/2475] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:18.519952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99280e4-2375-45b4-a9e1-9d642eae98e3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.527271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1241/2476] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:18.528515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed9451-97e8-468e-8c25-ff522fadb1ed admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.530822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99280e4-2375-45b4-a9e1-9d642eae98e3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.533701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:18.536812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38bc7a-0785-4866-9bfb-072903000667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.537670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bc7a-0785-4866-9bfb-072903000667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.537943 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bc7a-0785-4866-9bfb-072903000667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.538212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38bc7a-0785-4866-9bfb-072903000667 admin admin] PATH_INFO: `/v3/projects/dc8b140036f5450b8c03c3ea6440b9ea/users/2b49e11b75464a89b0e707b32254f2a9/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.539467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed9451-97e8-468e-8c25-ff522fadb1ed admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.544653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d0853-3ddd-40c8-afd0-15cfc28e20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.545638 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0853-3ddd-40c8-afd0-15cfc28e20bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.545917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0853-3ddd-40c8-afd0-15cfc28e20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.546187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0853-3ddd-40c8-afd0-15cfc28e20bb admin admin] PATH_INFO: `/v3/projects/c0c30d8225af41abb16fcd38f63fbc48/users/33ad482f856540a899d4c41d0907215d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.562831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38bc7a-0785-4866-9bfb-072903000667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8b140036f5450b8c03c3ea6440b9ea, user_id=2b49e11b75464a89b0e707b32254f2a9, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.562831 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38bc7a-0785-4866-9bfb-072903000667 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.646583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d0853-3ddd-40c8-afd0-15cfc28e20bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c30d8225af41abb16fcd38f63fbc48, user_id=33ad482f856540a899d4c41d0907215d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.646583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d0853-3ddd-40c8-afd0-15cfc28e20bb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.647431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:18.690181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1236/2477] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:18 2022] PUT /identity/v3/projects/dc8b140036f5450b8c03c3ea6440b9ea/users/2b49e11b75464a89b0e707b32254f2a9/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:18.694242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38bc7a-0785-4866-9bfb-072903000667 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.707647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1242/2478] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:18 2022] PUT /identity/v3/projects/c0c30d8225af41abb16fcd38f63fbc48/users/33ad482f856540a899d4c41d0907215d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:18.714313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d0853-3ddd-40c8-afd0-15cfc28e20bb admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.761687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38bc7a-0785-4866-9bfb-072903000667 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.777830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d0853-3ddd-40c8-afd0-15cfc28e20bb admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.783438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5169b6b-6e40-4db1-828e-84270e9ad5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.784164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5169b6b-6e40-4db1-828e-84270e9ad5df admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.784448 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5169b6b-6e40-4db1-828e-84270e9ad5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.784723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5169b6b-6e40-4db1-828e-84270e9ad5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.786398 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5169b6b-6e40-4db1-828e-84270e9ad5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.789558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5169b6b-6e40-4db1-828e-84270e9ad5df admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.801045 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1243/2479] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:18.802689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5169b6b-6e40-4db1-828e-84270e9ad5df admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.813226 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5169b6b-6e40-4db1-828e-84270e9ad5df admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.818458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49be54-42c1-41fb-a647-41e9bdf9a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.819141 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49be54-42c1-41fb-a647-41e9bdf9a130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.826555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49be54-42c1-41fb-a647-41e9bdf9a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.826555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49be54-42c1-41fb-a647-41e9bdf9a130 admin admin] PATH_INFO: `/v3/projects/c0c30d8225af41abb16fcd38f63fbc48/users/33ad482f856540a899d4c41d0907215d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.827090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa91add-c9d4-424f-a0dc-3dc8eb212dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.827090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa91add-c9d4-424f-a0dc-3dc8eb212dac admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.827301 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49be54-42c1-41fb-a647-41e9bdf9a130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c30d8225af41abb16fcd38f63fbc48, user_id=33ad482f856540a899d4c41d0907215d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.827401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa91add-c9d4-424f-a0dc-3dc8eb212dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.827401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa91add-c9d4-424f-a0dc-3dc8eb212dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.827401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa91add-c9d4-424f-a0dc-3dc8eb212dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.827401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa91add-c9d4-424f-a0dc-3dc8eb212dac admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.827738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49be54-42c1-41fb-a647-41e9bdf9a130 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.835731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1237/2480] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:18.836069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1244/2481] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:18 2022] PUT /identity/v3/projects/c0c30d8225af41abb16fcd38f63fbc48/users/33ad482f856540a899d4c41d0907215d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:18.839960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa91add-c9d4-424f-a0dc-3dc8eb212dac admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.846293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986298-e9a8-4891-a64e-b39e6bdd6627 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.846586 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986298-e9a8-4891-a64e-b39e6bdd6627 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.846866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986298-e9a8-4891-a64e-b39e6bdd6627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.851421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa91add-c9d4-424f-a0dc-3dc8eb212dac admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:18.877572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f6986298-e9a8-4891-a64e-b39e6bdd6627 None None] MFA Rules not processed for user `33ad482f856540a899d4c41d0907215d`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:18.878848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f6986298-e9a8-4891-a64e-b39e6bdd6627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:18.909510 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd46dbb-74bd-4b67-aa5f-3c2453f971fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:18.910698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46dbb-74bd-4b67-aa5f-3c2453f971fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.910976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46dbb-74bd-4b67-aa5f-3c2453f971fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.911307 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46dbb-74bd-4b67-aa5f-3c2453f971fb admin admin] PATH_INFO: `/v3/projects/dc8b140036f5450b8c03c3ea6440b9ea/users/2b49e11b75464a89b0e707b32254f2a9/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.913476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd46dbb-74bd-4b67-aa5f-3c2453f971fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8b140036f5450b8c03c3ea6440b9ea, user_id=2b49e11b75464a89b0e707b32254f2a9, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:18.916269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd46dbb-74bd-4b67-aa5f-3c2453f971fb admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:18.927699 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1238/2482] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:18 2022] PUT /identity/v3/projects/dc8b140036f5450b8c03c3ea6440b9ea/users/2b49e11b75464a89b0e707b32254f2a9/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:18.937990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23629-4448-4aad-b70a-7ccd01bd0125 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:18.938745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23629-4448-4aad-b70a-7ccd01bd0125 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:18.938745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca23629-4448-4aad-b70a-7ccd01bd0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:18.949548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1245/2483] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:18.962223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986298-e9a8-4891-a64e-b39e6bdd6627 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:18.963695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f6986298-e9a8-4891-a64e-b39e6bdd6627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:18.969586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0ca23629-4448-4aad-b70a-7ccd01bd0125 None None] MFA Rules not processed for user `2b49e11b75464a89b0e707b32254f2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:18.970778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0ca23629-4448-4aad-b70a-7ccd01bd0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:18.998875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:19.018772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:19.025212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986298-e9a8-4891-a64e-b39e6bdd6627 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:19.043315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1239/2484] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:19.054805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca23629-4448-4aad-b70a-7ccd01bd0125 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:19.056194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0ca23629-4448-4aad-b70a-7ccd01bd0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:19.075567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b15d3-d67b-40a0-909f-cdc93cf6a43e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:19.076142 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b15d3-d67b-40a0-909f-cdc93cf6a43e service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:19.076431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b15d3-d67b-40a0-909f-cdc93cf6a43e service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:19.076727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b15d3-d67b-40a0-909f-cdc93cf6a43e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:19.114124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca23629-4448-4aad-b70a-7ccd01bd0125 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:19.117825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f2f23-0baf-485d-ad79-9e5146b582a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:19.118443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f2f23-0baf-485d-ad79-9e5146b582a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:19.118718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f2f23-0baf-485d-ad79-9e5146b582a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:19.118986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f2f23-0baf-485d-ad79-9e5146b582a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:19.139711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b15d3-d67b-40a0-909f-cdc93cf6a43e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:19.141203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b15d3-d67b-40a0-909f-cdc93cf6a43e service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:19.151805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1246/2485] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:19.177383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f2f23-0baf-485d-ad79-9e5146b582a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:19.178871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f2f23-0baf-485d-ad79-9e5146b582a6 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:19.188130 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1240/2486] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:19.400121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b15d3-d67b-40a0-909f-cdc93cf6a43e service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:19.408966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b15d3-d67b-40a0-909f-cdc93cf6a43e service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:19.413681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da3749-392e-4178-b762-958fe5df1cf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:19.414419 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da3749-392e-4178-b762-958fe5df1cf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:19.414827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da3749-392e-4178-b762-958fe5df1cf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:19.415103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da3749-392e-4178-b762-958fe5df1cf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:19.474800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da3749-392e-4178-b762-958fe5df1cf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:19.476354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da3749-392e-4178-b762-958fe5df1cf4 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:19.485437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1247/2487] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:21.034150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f2f23-0baf-485d-ad79-9e5146b582a6 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:21.044127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f2f23-0baf-485d-ad79-9e5146b582a6 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:21.047904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ffd7d-868e-4a3e-a22d-d892c0d1d735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:21.048500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd7d-868e-4a3e-a22d-d892c0d1d735 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:21.048778 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd7d-868e-4a3e-a22d-d892c0d1d735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:21.049085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd7d-868e-4a3e-a22d-d892c0d1d735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:21.059675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ffd7d-868e-4a3e-a22d-d892c0d1d735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:21.061188 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ffd7d-868e-4a3e-a22d-d892c0d1d735 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:21.071059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1241/2488] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:25.359070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da3749-392e-4178-b762-958fe5df1cf4 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:25.412943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:25.427860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da3749-392e-4178-b762-958fe5df1cf4 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:25.433127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:25.433818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:25.434093 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:25.434362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] PATH_INFO: `/v3/users/687ccb2bb9364403b45c80e870f317a1` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:25.435516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687ccb2bb9364403b45c80e870f317a1)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:25.441362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:25.670502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687ccb2bb9364403b45c80e870f317a1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:25.678103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687ccb2bb9364403b45c80e870f317a1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:25.755889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687ccb2bb9364403b45c80e870f317a1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:25.768875 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687ccb2bb9364403b45c80e870f317a1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:25.769527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687ccb2bb9364403b45c80e870f317a1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:25.776862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1248/2489] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:25 2022] DELETE /identity/v3/users/687ccb2bb9364403b45c80e870f317a1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:25.781489 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c651442-6bda-4ce9-b04d-af7f87458395 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:25.781946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c651442-6bda-4ce9-b04d-af7f87458395 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:25.782076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c651442-6bda-4ce9-b04d-af7f87458395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:25.790309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:25.803504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-8c651442-6bda-4ce9-b04d-af7f87458395 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:25.804969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8c651442-6bda-4ce9-b04d-af7f87458395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:25.869627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1242/2490] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:25.879257 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:25.880767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:25.943646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4dd2-6dff-4756-98a7-949cd3b729c6 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:25.948062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166f9a-e581-4356-a5ce-939c31e13602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:25.948544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166f9a-e581-4356-a5ce-939c31e13602 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:25.952208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166f9a-e581-4356-a5ce-939c31e13602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:25.952208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166f9a-e581-4356-a5ce-939c31e13602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:25.959077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c166f9a-e581-4356-a5ce-939c31e13602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:25.960537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c166f9a-e581-4356-a5ce-939c31e13602 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:25.970754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1249/2491] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:26.376546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c651442-6bda-4ce9-b04d-af7f87458395 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:26.378030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8c651442-6bda-4ce9-b04d-af7f87458395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:26.391212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c651442-6bda-4ce9-b04d-af7f87458395 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:26.397036 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:26.397767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:26.398040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:26.398972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] PATH_INFO: `/v3/projects/248ba76891ff4fadaf1feb5c54b67665` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:26.407997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=248ba76891ff4fadaf1feb5c54b67665)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:26.407997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:26.544217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248ba76891ff4fadaf1feb5c54b67665', 'request_id': 'req-efec0119-25b3-4751-8f5c-095b0e0d6b0f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:26.549896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248ba76891ff4fadaf1feb5c54b67665', 'request_id': 'req-efec0119-25b3-4751-8f5c-095b0e0d6b0f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:26.643723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248ba76891ff4fadaf1feb5c54b67665', 'request_id': 'req-efec0119-25b3-4751-8f5c-095b0e0d6b0f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:26.658371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] The token cache is being invalidate because project 248ba76891ff4fadaf1feb5c54b67665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:26.658724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:26.660633 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:26.662168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1243/2492] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:26 2022] DELETE /identity/v3/projects/248ba76891ff4fadaf1feb5c54b67665 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:26.666991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166f9a-e581-4356-a5ce-939c31e13602 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:26.677165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166f9a-e581-4356-a5ce-939c31e13602 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:26.736543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:26.737209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:26.737497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:26.737771 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] PATH_INFO: `/v3/users/2b49e11b75464a89b0e707b32254f2a9` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:26.738938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b49e11b75464a89b0e707b32254f2a9)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:26.741044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:26.754986 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:26.925460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b49e11b75464a89b0e707b32254f2a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:26.932395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b49e11b75464a89b0e707b32254f2a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.001619 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b49e11b75464a89b0e707b32254f2a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.014436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b49e11b75464a89b0e707b32254f2a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.015022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f00bc153-8d96-4c4e-be33-aa35b3d97125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b49e11b75464a89b0e707b32254f2a9'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.021316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1250/2493] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:26 2022] DELETE /identity/v3/users/2b49e11b75464a89b0e707b32254f2a9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:27.459649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:27.461172 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:27.479118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0119-25b3-4751-8f5c-095b0e0d6b0f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:27.541625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:27.542275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:27.543164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:27.543164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] PATH_INFO: `/v3/projects/dc8b140036f5450b8c03c3ea6440b9ea` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:27.544008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8b140036f5450b8c03c3ea6440b9ea)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:27.546591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:27.638902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:27.655439 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8b140036f5450b8c03c3ea6440b9ea', 'request_id': 'req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.660908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8b140036f5450b8c03c3ea6440b9ea', 'request_id': 'req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.723604 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8b140036f5450b8c03c3ea6440b9ea', 'request_id': 'req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.735869 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] The token cache is being invalidate because project dc8b140036f5450b8c03c3ea6440b9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:27.736162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.736816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c835e5ba-d6ad-4caa-b0fa-816c8c67fa21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:27.738572 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1244/2494] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:27 2022] DELETE /identity/v3/projects/dc8b140036f5450b8c03c3ea6440b9ea => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:27.744447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e833a-da16-415f-b1f8-1355373971ad None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:27.745021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e833a-da16-415f-b1f8-1355373971ad None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:27.749982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e833a-da16-415f-b1f8-1355373971ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:27.770036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-108e833a-da16-415f-b1f8-1355373971ad None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:27.771539 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-108e833a-da16-415f-b1f8-1355373971ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:27.835536 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1251/2495] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:27.844427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585486-a59c-4753-842e-c18efa8ead80 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:27.844709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585486-a59c-4753-842e-c18efa8ead80 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:27.845018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585486-a59c-4753-842e-c18efa8ead80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:27.864792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-16585486-a59c-4753-842e-c18efa8ead80 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:27.866018 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-16585486-a59c-4753-842e-c18efa8ead80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:27.875000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1245/2496] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:27.879278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e833a-da16-415f-b1f8-1355373971ad None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:27.890893 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e833a-da16-415f-b1f8-1355373971ad None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:27.895535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:27.896403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:27.896683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:27.896993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:27.897691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:27.897996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:27.899959 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:27.913351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1252/2497] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:27.918073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585486-a59c-4753-842e-c18efa8ead80 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:27.928645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585486-a59c-4753-842e-c18efa8ead80 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:27.934764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea10852-89a1-4ec2-8dbd-5652a7df180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:27.935379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea10852-89a1-4ec2-8dbd-5652a7df180e admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:27.941153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea10852-89a1-4ec2-8dbd-5652a7df180e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:27.941153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea10852-89a1-4ec2-8dbd-5652a7df180e admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:27.941153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea10852-89a1-4ec2-8dbd-5652a7df180e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:27.941153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea10852-89a1-4ec2-8dbd-5652a7df180e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.063395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1246/2498] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:27 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:28.067459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.078490 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf281-165b-482a-8905-4f13f9af851c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.140040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.146384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.146384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.146384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.146384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.146384 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.238213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1253/2499] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:28 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:28.242463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea10852-89a1-4ec2-8dbd-5652a7df180e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.254643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.255382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea10852-89a1-4ec2-8dbd-5652a7df180e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.256353 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:28.260057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215afb7-ec80-481f-918b-2dddb8f89f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.260672 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215afb7-ec80-481f-918b-2dddb8f89f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.260998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215afb7-ec80-481f-918b-2dddb8f89f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.261322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215afb7-ec80-481f-918b-2dddb8f89f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.262042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215afb7-ec80-481f-918b-2dddb8f89f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.264008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215afb7-ec80-481f-918b-2dddb8f89f5a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.268924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0451c-94e3-4923-b7f4-4f420da99459 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.274526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.275548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.276146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.276146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] PATH_INFO: `/v3/users/00b2b6b3f98a40b9876bd6bcffcbddb1` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.277434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b2b6b3f98a40b9876bd6bcffcbddb1)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.278030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1247/2500] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:28.279385 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.281955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215afb7-ec80-481f-918b-2dddb8f89f5a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.283303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:28.293264 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215afb7-ec80-481f-918b-2dddb8f89f5a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.297970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfdebc-a0ea-4f36-8518-dcfc8967a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.298577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfdebc-a0ea-4f36-8518-dcfc8967a7ef admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.298856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfdebc-a0ea-4f36-8518-dcfc8967a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.299123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfdebc-a0ea-4f36-8518-dcfc8967a7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.299815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfdebc-a0ea-4f36-8518-dcfc8967a7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.301428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfdebc-a0ea-4f36-8518-dcfc8967a7ef admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.312331 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1248/2501] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:28.316543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfdebc-a0ea-4f36-8518-dcfc8967a7ef admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.326563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfdebc-a0ea-4f36-8518-dcfc8967a7ef admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.331292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa552-5091-4aa9-b465-72a2e90eff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.331923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa552-5091-4aa9-b465-72a2e90eff3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.332201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa552-5091-4aa9-b465-72a2e90eff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.332478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa552-5091-4aa9-b465-72a2e90eff3e admin admin] PATH_INFO: `/v3/projects/fb4e8cf9b2bc4ef489b53b84fb748277/users/03fd356d2bf1434dbfe79a153d6a6296/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.347052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfa552-5091-4aa9-b465-72a2e90eff3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb4e8cf9b2bc4ef489b53b84fb748277, user_id=03fd356d2bf1434dbfe79a153d6a6296, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.350013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfa552-5091-4aa9-b465-72a2e90eff3e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.427197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1249/2502] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:28 2022] PUT /identity/v3/projects/fb4e8cf9b2bc4ef489b53b84fb748277/users/03fd356d2bf1434dbfe79a153d6a6296/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:28.438679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17766c5-b340-4f27-9788-9e19f4e428bf None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.438967 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17766c5-b340-4f27-9788-9e19f4e428bf None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.439245 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17766c5-b340-4f27-9788-9e19f4e428bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.450098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b2b6b3f98a40b9876bd6bcffcbddb1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:28.456910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b2b6b3f98a40b9876bd6bcffcbddb1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:28.467322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c17766c5-b340-4f27-9788-9e19f4e428bf None None] MFA Rules not processed for user `03fd356d2bf1434dbfe79a153d6a6296`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:28.468554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c17766c5-b340-4f27-9788-9e19f4e428bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:28.533022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b2b6b3f98a40b9876bd6bcffcbddb1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:28.535085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1250/2503] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:28.540287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17766c5-b340-4f27-9788-9e19f4e428bf None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.546761 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b2b6b3f98a40b9876bd6bcffcbddb1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:28.547464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d2d43114-17d8-4284-9a55-a316df94cb13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b2b6b3f98a40b9876bd6bcffcbddb1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:28.553684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1254/2504] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:28 2022] DELETE /identity/v3/users/00b2b6b3f98a40b9876bd6bcffcbddb1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:28.558857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1763-c6b3-4f8a-84e3-e07b66f4b69f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.559307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1763-c6b3-4f8a-84e3-e07b66f4b69f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.559566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1763-c6b3-4f8a-84e3-e07b66f4b69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.577074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:28.579366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-05df1763-c6b3-4f8a-84e3-e07b66f4b69f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:28.580607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-05df1763-c6b3-4f8a-84e3-e07b66f4b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:28.608255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17766c5-b340-4f27-9788-9e19f4e428bf None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.644739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1255/2505] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:28.654942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df1763-c6b3-4f8a-84e3-e07b66f4b69f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.656364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-05df1763-c6b3-4f8a-84e3-e07b66f4b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:28.667164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5cdd-6863-4787-b1e2-55fdb7b401ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.667788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5cdd-6863-4787-b1e2-55fdb7b401ba admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.668058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5cdd-6863-4787-b1e2-55fdb7b401ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.668326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5cdd-6863-4787-b1e2-55fdb7b401ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.669096 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f5cdd-6863-4787-b1e2-55fdb7b401ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.671181 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f5cdd-6863-4787-b1e2-55fdb7b401ba admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.715495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df1763-c6b3-4f8a-84e3-e07b66f4b69f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.719222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.719837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.720116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.720388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.729764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.731249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.741165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1256/2506] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:28.764366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1251/2507] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:28 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:28.765528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.766952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:28.780004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bdcc6-9d07-412a-8851-df55eab3098b service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.800046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:28.839509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990f13-9a53-4c9e-be0b-b8dafde97a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.840137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990f13-9a53-4c9e-be0b-b8dafde97a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.840808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990f13-9a53-4c9e-be0b-b8dafde97a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.841170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990f13-9a53-4c9e-be0b-b8dafde97a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.841830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f990f13-9a53-4c9e-be0b-b8dafde97a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.843841 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f990f13-9a53-4c9e-be0b-b8dafde97a00 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.940568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1257/2508] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:28 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:28.944670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5cdd-6863-4787-b1e2-55fdb7b401ba admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.956916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5cdd-6863-4787-b1e2-55fdb7b401ba admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:28.962660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373604b-8625-462e-b14f-6ff4d64160bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:28.966224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373604b-8625-462e-b14f-6ff4d64160bf admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:28.966224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373604b-8625-462e-b14f-6ff4d64160bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:28.966224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373604b-8625-462e-b14f-6ff4d64160bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:28.966224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373604b-8625-462e-b14f-6ff4d64160bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:28.966860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373604b-8625-462e-b14f-6ff4d64160bf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:28.982870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1252/2509] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:28.987221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990f13-9a53-4c9e-be0b-b8dafde97a00 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:28.998363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990f13-9a53-4c9e-be0b-b8dafde97a00 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:29.003475 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d74afb-3efc-49c5-82d1-3810f90105cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:29.004147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74afb-3efc-49c5-82d1-3810f90105cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:29.004568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74afb-3efc-49c5-82d1-3810f90105cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:29.004877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74afb-3efc-49c5-82d1-3810f90105cd admin admin] PATH_INFO: `/v3/projects/64026fe8397546a7a6a7ebb8943930b1/users/07e6757ee10d47f8a7dca9a6b97aaa7d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:29.022114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d74afb-3efc-49c5-82d1-3810f90105cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64026fe8397546a7a6a7ebb8943930b1, user_id=07e6757ee10d47f8a7dca9a6b97aaa7d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:29.025718 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d74afb-3efc-49c5-82d1-3810f90105cd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:29.112719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1258/2510] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:28 2022] PUT /identity/v3/projects/64026fe8397546a7a6a7ebb8943930b1/users/07e6757ee10d47f8a7dca9a6b97aaa7d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:29.116741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373604b-8625-462e-b14f-6ff4d64160bf admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:29.127802 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373604b-8625-462e-b14f-6ff4d64160bf admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:29.185497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:29.186119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:29.186400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:29.186674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:29.187384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:29.189953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:29.204704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1253/2511] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:29.205807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d74afb-3efc-49c5-82d1-3810f90105cd admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:29.223214 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:29.225911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:29.232431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d74afb-3efc-49c5-82d1-3810f90105cd admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:29.237331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4276558-0e36-442e-9168-2997f1e5ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:29.238008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4276558-0e36-442e-9168-2997f1e5ed9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:29.238981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4276558-0e36-442e-9168-2997f1e5ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:29.239259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4276558-0e36-442e-9168-2997f1e5ed9a admin admin] PATH_INFO: `/v3/projects/64026fe8397546a7a6a7ebb8943930b1/users/07e6757ee10d47f8a7dca9a6b97aaa7d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:29.242091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc76247-a08b-4bed-ad6d-fb93bb6c683b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:29.245763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4276558-0e36-442e-9168-2997f1e5ed9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64026fe8397546a7a6a7ebb8943930b1, user_id=07e6757ee10d47f8a7dca9a6b97aaa7d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:29.250624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:29.250624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:29.250624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:29.251138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4276558-0e36-442e-9168-2997f1e5ed9a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:29.251230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] PATH_INFO: `/v3/projects/7b59d7ca505c4e198122e95716ffa8a4` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:29.252126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b59d7ca505c4e198122e95716ffa8a4)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:29.254086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:29.263884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1259/2512] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:29 2022] PUT /identity/v3/projects/64026fe8397546a7a6a7ebb8943930b1/users/07e6757ee10d47f8a7dca9a6b97aaa7d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:29.275712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f57a-c20e-4765-a204-f12212bfa716 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:29.286952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f57a-c20e-4765-a204-f12212bfa716 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:29.286952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f57a-c20e-4765-a204-f12212bfa716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:29.306832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-6074f57a-c20e-4765-a204-f12212bfa716 None None] MFA Rules not processed for user `07e6757ee10d47f8a7dca9a6b97aaa7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:29.309684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6074f57a-c20e-4765-a204-f12212bfa716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:29.386302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1260/2513] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:29.404130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074f57a-c20e-4765-a204-f12212bfa716 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:29.406167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6074f57a-c20e-4765-a204-f12212bfa716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:29.417602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:29.422220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b59d7ca505c4e198122e95716ffa8a4', 'request_id': 'req-7cf94eb6-ea5c-4502-9023-117a02d94d22'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.430662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b59d7ca505c4e198122e95716ffa8a4', 'request_id': 'req-7cf94eb6-ea5c-4502-9023-117a02d94d22'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.472850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074f57a-c20e-4765-a204-f12212bfa716 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:29.487271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:29.524853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b59d7ca505c4e198122e95716ffa8a4', 'request_id': 'req-7cf94eb6-ea5c-4502-9023-117a02d94d22'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.533173 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:29.534047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:29.534179 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:29.534474 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:29.542515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] The token cache is being invalidate because project 7b59d7ca505c4e198122e95716ffa8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:29.542873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.543652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.548455 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1254/2514] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:29 2022] DELETE /identity/v3/projects/7b59d7ca505c4e198122e95716ffa8a4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:29.549901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:29.551338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:29.599793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:29.601286 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:29.612332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1261/2515] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:29.623179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf94eb6-ea5c-4502-9023-117a02d94d22 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:29.628147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:29.628792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:29.629106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:29.629379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] PATH_INFO: `/v3/users/33ad482f856540a899d4c41d0907215d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:29.630621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ad482f856540a899d4c41d0907215d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:29.632637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:29.875984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ad482f856540a899d4c41d0907215d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.876857 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ad482f856540a899d4c41d0907215d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.877760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ad482f856540a899d4c41d0907215d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.891993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ad482f856540a899d4c41d0907215d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.956135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ad482f856540a899d4c41d0907215d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:29.971001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1255/2516] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:29 2022] DELETE /identity/v3/users/33ad482f856540a899d4c41d0907215d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:30.329552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:30.331147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:30.345064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e8b06-e943-4f2e-ba04-485a0fbb1cf6 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:30.403538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:30.404184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:30.404466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:30.404742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] PATH_INFO: `/v3/users/ac18ec901c804f8c9c5b2ff9dc360f96` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:30.406094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac18ec901c804f8c9c5b2ff9dc360f96)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:30.407880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:30.440172 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:30.441799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:30.461357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437e95-f7a8-42d2-9c7c-7d65b41fd765 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:30.469833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:30.469833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:30.469833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:30.469833 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] PATH_INFO: `/v3/projects/c0c30d8225af41abb16fcd38f63fbc48` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:30.471050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c30d8225af41abb16fcd38f63fbc48)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:30.472148 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:30.657359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:30.659513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac18ec901c804f8c9c5b2ff9dc360f96'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.661013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c30d8225af41abb16fcd38f63fbc48', 'request_id': 'req-665c9f95-fec0-40a2-a27f-f5c4e434d378'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.667547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c30d8225af41abb16fcd38f63fbc48', 'request_id': 'req-665c9f95-fec0-40a2-a27f-f5c4e434d378'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.668676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac18ec901c804f8c9c5b2ff9dc360f96'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.793800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c30d8225af41abb16fcd38f63fbc48', 'request_id': 'req-665c9f95-fec0-40a2-a27f-f5c4e434d378'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.807295 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] The token cache is being invalidate because project c0c30d8225af41abb16fcd38f63fbc48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:30.807585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.808242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.809797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1256/2517] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:30 2022] DELETE /identity/v3/projects/c0c30d8225af41abb16fcd38f63fbc48 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:30.810561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:30.811863 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:30.849412 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac18ec901c804f8c9c5b2ff9dc360f96'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.856075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:30.864023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac18ec901c804f8c9c5b2ff9dc360f96'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.864800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e576845f-9e62-44eb-9a66-e59739f54442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac18ec901c804f8c9c5b2ff9dc360f96'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:30.871391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1262/2518] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:30 2022] DELETE /identity/v3/users/ac18ec901c804f8c9c5b2ff9dc360f96 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:30.874723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73237cd-d694-479d-b6c4-9f7d5bc06809 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:30.874723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73237cd-d694-479d-b6c4-9f7d5bc06809 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:30.874723 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73237cd-d694-479d-b6c4-9f7d5bc06809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:30.878963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9f95-fec0-40a2-a27f-f5c4e434d378 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:30.892984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c73237cd-d694-479d-b6c4-9f7d5bc06809 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:30.894206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c73237cd-d694-479d-b6c4-9f7d5bc06809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:30.937618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1067b-a36b-4b21-941f-d5a7408437ea tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e6757ee10d47f8a7dca9a6b97aaa7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64026fe8397546a7a6a7ebb8943930b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:30.938147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1067b-a36b-4b21-941f-d5a7408437ea tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:30.938428 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1067b-a36b-4b21-941f-d5a7408437ea tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:30.938700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1067b-a36b-4b21-941f-d5a7408437ea tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:30.939378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1067b-a36b-4b21-941f-d5a7408437ea tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:30.939678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1067b-a36b-4b21-941f-d5a7408437ea tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:30.941434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1067b-a36b-4b21-941f-d5a7408437ea tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:30.957397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1257/2519] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:30.957584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1263/2520] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:30.958369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73237cd-d694-479d-b6c4-9f7d5bc06809 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:30.958674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c17bb-53b8-42a7-9c57-76cbd0eb129b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:30.958972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c17bb-53b8-42a7-9c57-76cbd0eb129b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:30.959255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c17bb-53b8-42a7-9c57-76cbd0eb129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:30.960183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c73237cd-d694-479d-b6c4-9f7d5bc06809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:30.976824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73237cd-d694-479d-b6c4-9f7d5bc06809 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:30.982788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c236-8b99-404d-abe7-9ce529286603 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e6757ee10d47f8a7dca9a6b97aaa7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64026fe8397546a7a6a7ebb8943930b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:30.982949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6d7c17bb-53b8-42a7-9c57-76cbd0eb129b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:30.983422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c236-8b99-404d-abe7-9ce529286603 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:30.983709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c236-8b99-404d-abe7-9ce529286603 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:30.983987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c236-8b99-404d-abe7-9ce529286603 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:30.984100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6d7c17bb-53b8-42a7-9c57-76cbd0eb129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:30.984664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5c236-8b99-404d-abe7-9ce529286603 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:30.986614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5c236-8b99-404d-abe7-9ce529286603 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:30.991835 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1258/2521] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:30.993054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353e71-a652-4ac7-b13f-602289548259 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:30.993355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353e71-a652-4ac7-b13f-602289548259 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:30.993979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b353e71-a652-4ac7-b13f-602289548259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.013057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6b353e71-a652-4ac7-b13f-602289548259 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:31.014269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6b353e71-a652-4ac7-b13f-602289548259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:31.022522 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1259/2522] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:31.023312 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b353e71-a652-4ac7-b13f-602289548259 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.028443 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6b353e71-a652-4ac7-b13f-602289548259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:31.081210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1264/2523] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:30 2022] POST /identity/v3/projects => generated 354 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:31.081210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c236-8b99-404d-abe7-9ce529286603 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.082438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b353e71-a652-4ac7-b13f-602289548259 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.125874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:31.137078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35613165-d1ed-4ca6-84f8-72d81705929b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.137701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35613165-d1ed-4ca6-84f8-72d81705929b service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.137981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35613165-d1ed-4ca6-84f8-72d81705929b service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.138250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35613165-d1ed-4ca6-84f8-72d81705929b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.152801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c236-8b99-404d-abe7-9ce529286603 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.158432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.160639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.160639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.160639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.160639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:31.160639 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.162504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.175629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1265/2524] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:31.176295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.201149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35613165-d1ed-4ca6-84f8-72d81705929b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.202541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35613165-d1ed-4ca6-84f8-72d81705929b service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.213995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1260/2525] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:31.214639 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35613165-d1ed-4ca6-84f8-72d81705929b service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.224383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35613165-d1ed-4ca6-84f8-72d81705929b service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.229957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad404e18-b712-44b3-b0fc-8da707833778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.230569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad404e18-b712-44b3-b0fc-8da707833778 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.230849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad404e18-b712-44b3-b0fc-8da707833778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.231335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad404e18-b712-44b3-b0fc-8da707833778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.232004 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad404e18-b712-44b3-b0fc-8da707833778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.233980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad404e18-b712-44b3-b0fc-8da707833778 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.248657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d023c08-bd60-4165-ab5c-f79e9833c5a3 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.253807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e6757ee10d47f8a7dca9a6b97aaa7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64026fe8397546a7a6a7ebb8943930b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.254434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.254881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.255160 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.256235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:31.256695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.258411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.260442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:31.272568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1266/2526] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:31.311744 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.322274 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6599b0c-929a-4d2a-b5ef-7b21fd34b7a3 tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.327119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e6757ee10d47f8a7dca9a6b97aaa7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64026fe8397546a7a6a7ebb8943930b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.327633 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.327922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.328196 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] PATH_INFO: `/v3/projects/e990011415cb43bba9be58dfb6ca94a0` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.329391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e990011415cb43bba9be58dfb6ca94a0)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.331355 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.360933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1261/2527] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:31 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:31.364710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad404e18-b712-44b3-b0fc-8da707833778 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.427842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad404e18-b712-44b3-b0fc-8da707833778 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.433449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c005-30e2-49f6-b495-14f4ab3fb554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.434060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c005-30e2-49f6-b495-14f4ab3fb554 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.434337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c005-30e2-49f6-b495-14f4ab3fb554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.434609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c005-30e2-49f6-b495-14f4ab3fb554 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.435270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3c005-30e2-49f6-b495-14f4ab3fb554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.437247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3c005-30e2-49f6-b495-14f4ab3fb554 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.495772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e990011415cb43bba9be58dfb6ca94a0', 'request_id': 'req-d48170ab-3a1e-4605-a904-d9ba286057ad'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:31.502946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e990011415cb43bba9be58dfb6ca94a0', 'request_id': 'req-d48170ab-3a1e-4605-a904-d9ba286057ad'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:31.530842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1262/2528] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:31 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:31.534484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c005-30e2-49f6-b495-14f4ab3fb554 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.545471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c005-30e2-49f6-b495-14f4ab3fb554 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.582498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:31.611952 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74626600-c361-4b6a-9fc2-85cf652b1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.612577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74626600-c361-4b6a-9fc2-85cf652b1250 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.612851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74626600-c361-4b6a-9fc2-85cf652b1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.613186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74626600-c361-4b6a-9fc2-85cf652b1250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.613996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74626600-c361-4b6a-9fc2-85cf652b1250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.615589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74626600-c361-4b6a-9fc2-85cf652b1250 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.618674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e990011415cb43bba9be58dfb6ca94a0', 'request_id': 'req-d48170ab-3a1e-4605-a904-d9ba286057ad'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:31.626026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1263/2529] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:31.629859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74626600-c361-4b6a-9fc2-85cf652b1250 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.631027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] The token cache is being invalidate because project e990011415cb43bba9be58dfb6ca94a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:31.631322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:31.631984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:31.633714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1267/2530] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:31 2022] DELETE /identity/v3/projects/e990011415cb43bba9be58dfb6ca94a0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:31.640313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74626600-c361-4b6a-9fc2-85cf652b1250 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.650555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.650555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.650555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.650555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.650962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.650962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.664348 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1264/2531] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:31.665863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.668182 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:31.685830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48170ab-3a1e-4605-a904-d9ba286057ad tempest-VolumeQuotaClassesTest-1318906620 tempest-VolumeQuotaClassesTest-1318906620-project-admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.691615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fafeb-dea7-488d-93dd-e67d849d9e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.692290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fafeb-dea7-488d-93dd-e67d849d9e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.692599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fafeb-dea7-488d-93dd-e67d849d9e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.692912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fafeb-dea7-488d-93dd-e67d849d9e71 admin admin] PATH_INFO: `/v3/projects/1c0780b7a636407393bd966cb0bf2c2f/users/c1c6a8e9097244d5868b4fe357e9b9da/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.715612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.717465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fafeb-dea7-488d-93dd-e67d849d9e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0780b7a636407393bd966cb0bf2c2f, user_id=c1c6a8e9097244d5868b4fe357e9b9da, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.717600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:31.720369 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fafeb-dea7-488d-93dd-e67d849d9e71 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.748723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24919e-fd4c-4936-86a4-227ba8683f6b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:31.753858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:31.754619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.754970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.755313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] PATH_INFO: `/v3/projects/a6cf726177754338bb4e0ec7ba0a6261` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.756573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6cf726177754338bb4e0ec7ba0a6261)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:31.758887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:31.809277 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1268/2532] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:31 2022] PUT /identity/v3/projects/1c0780b7a636407393bd966cb0bf2c2f/users/c1c6a8e9097244d5868b4fe357e9b9da/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:31.819504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081c50-86fd-450f-9430-3e7051ec56b1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:31.819874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081c50-86fd-450f-9430-3e7051ec56b1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:31.820212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081c50-86fd-450f-9430-3e7051ec56b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:31.849309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-74081c50-86fd-450f-9430-3e7051ec56b1 None None] MFA Rules not processed for user `c1c6a8e9097244d5868b4fe357e9b9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:31.850793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-74081c50-86fd-450f-9430-3e7051ec56b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:31.919961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1269/2533] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:31.924294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081c50-86fd-450f-9430-3e7051ec56b1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:31.946958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cf726177754338bb4e0ec7ba0a6261', 'request_id': 'req-a73fa306-2bfb-46e9-9930-5a012bb3166a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:31.952694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cf726177754338bb4e0ec7ba0a6261', 'request_id': 'req-a73fa306-2bfb-46e9-9930-5a012bb3166a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:31.987302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081c50-86fd-450f-9430-3e7051ec56b1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:32.000699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:32.044652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:32.045301 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.045587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.045879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.050579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:32.050579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:32.054038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cf726177754338bb4e0ec7ba0a6261', 'request_id': 'req-a73fa306-2bfb-46e9-9930-5a012bb3166a'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.067941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] The token cache is being invalidate because project a6cf726177754338bb4e0ec7ba0a6261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:32.068330 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.069098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.071132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1265/2534] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:31 2022] DELETE /identity/v3/projects/a6cf726177754338bb4e0ec7ba0a6261 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:32.075102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.076927 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:32.091645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fa306-2bfb-46e9-9930-5a012bb3166a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:32.096515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:32.097194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.097465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.097731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] PATH_INFO: `/v3/users/ee6bcff6077542529a92586f7d993cc0` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.099167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6bcff6077542529a92586f7d993cc0)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:32.101159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:32.140009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1270/2535] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:31 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:32.141382 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.143140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:32.216064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82f6f0-788a-4fb5-8746-3a34879e5313 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:32.221312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:32.222107 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.222483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.223441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.224147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:32.226349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:32.292243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6bcff6077542529a92586f7d993cc0'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.292243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6bcff6077542529a92586f7d993cc0'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.292684 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6bcff6077542529a92586f7d993cc0'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.304923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6bcff6077542529a92586f7d993cc0'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.321495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1271/2536] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:32 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:32.325544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.327431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:32.343070 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282f337-8492-4d9e-a5ed-ee00999706ae admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:32.348097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:32.349807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.349807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.349807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.350103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:32.351587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:32.363570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1272/2537] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:32.365826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.367625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:32.369682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6bcff6077542529a92586f7d993cc0'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.381853 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2b13-efef-4929-a5e9-a99d8d74459c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:32.386955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1266/2538] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:32 2022] DELETE /identity/v3/users/ee6bcff6077542529a92586f7d993cc0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:32.386955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.390328 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:32.391365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.391975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.392308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] PATH_INFO: `/v3/users/03fd356d2bf1434dbfe79a153d6a6296` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.393590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fd356d2bf1434dbfe79a153d6a6296)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:32.395689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:32.407678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:32.457413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dea70f-4405-48ea-9215-854037d894df admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:32.462955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64917519-5da3-41fe-8992-3d5aa8684c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:32.463674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917519-5da3-41fe-8992-3d5aa8684c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.463950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917519-5da3-41fe-8992-3d5aa8684c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.464227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917519-5da3-41fe-8992-3d5aa8684c2b admin admin] PATH_INFO: `/v3/projects/177fa3fa61a444579305ddb85202e1eb/users/a2613dfb492043f9b5934ba33ac41899/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.480082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64917519-5da3-41fe-8992-3d5aa8684c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=177fa3fa61a444579305ddb85202e1eb, user_id=a2613dfb492043f9b5934ba33ac41899, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:32.482997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64917519-5da3-41fe-8992-3d5aa8684c2b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:32.574568 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1267/2539] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:32 2022] PUT /identity/v3/projects/177fa3fa61a444579305ddb85202e1eb/users/a2613dfb492043f9b5934ba33ac41899/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:32.578864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64917519-5da3-41fe-8992-3d5aa8684c2b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.641845 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fd356d2bf1434dbfe79a153d6a6296'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.648946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64917519-5da3-41fe-8992-3d5aa8684c2b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:32.649978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fd356d2bf1434dbfe79a153d6a6296'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.654409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e821a8-9a37-437e-b1d1-b563d1047231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:32.655025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e821a8-9a37-437e-b1d1-b563d1047231 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.655786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e821a8-9a37-437e-b1d1-b563d1047231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.655902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e821a8-9a37-437e-b1d1-b563d1047231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.656577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e821a8-9a37-437e-b1d1-b563d1047231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:32.658197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e821a8-9a37-437e-b1d1-b563d1047231 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:32.668662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1268/2540] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:32.672566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e821a8-9a37-437e-b1d1-b563d1047231 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.682922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e821a8-9a37-437e-b1d1-b563d1047231 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:32.690203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6cbbc-7deb-4343-9ab3-87e64ad44297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:32.690203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6cbbc-7deb-4343-9ab3-87e64ad44297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.690203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6cbbc-7deb-4343-9ab3-87e64ad44297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.690203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6cbbc-7deb-4343-9ab3-87e64ad44297 admin admin] PATH_INFO: `/v3/projects/177fa3fa61a444579305ddb85202e1eb/users/a2613dfb492043f9b5934ba33ac41899/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.690694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6cbbc-7deb-4343-9ab3-87e64ad44297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177fa3fa61a444579305ddb85202e1eb, user_id=a2613dfb492043f9b5934ba33ac41899, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:32.693381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6cbbc-7deb-4343-9ab3-87e64ad44297 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:32.704048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1269/2541] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:32 2022] PUT /identity/v3/projects/177fa3fa61a444579305ddb85202e1eb/users/a2613dfb492043f9b5934ba33ac41899/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:32.716782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729f0c-96e1-42e5-9b4c-33ef614240e9 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.717254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729f0c-96e1-42e5-9b4c-33ef614240e9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.717678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729f0c-96e1-42e5-9b4c-33ef614240e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.734887 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fd356d2bf1434dbfe79a153d6a6296'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.751721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fd356d2bf1434dbfe79a153d6a6296'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.752207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-70729f0c-96e1-42e5-9b4c-33ef614240e9 None None] MFA Rules not processed for user `a2613dfb492043f9b5934ba33ac41899`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:32.752575 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-051f1997-acb0-4fd3-8b0d-c9f2bd09cfca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fd356d2bf1434dbfe79a153d6a6296'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:32.756775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-70729f0c-96e1-42e5-9b4c-33ef614240e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:32.762996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1273/2542] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:32 2022] DELETE /identity/v3/users/03fd356d2bf1434dbfe79a153d6a6296 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:32.767095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca3f2-f63d-489f-b459-eaa8d04fd49f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:32.767095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca3f2-f63d-489f-b459-eaa8d04fd49f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:32.767095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca3f2-f63d-489f-b459-eaa8d04fd49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:32.792567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-c05ca3f2-f63d-489f-b459-eaa8d04fd49f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:32.792958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c05ca3f2-f63d-489f-b459-eaa8d04fd49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:32.870012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1274/2543] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:32.886062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca3f2-f63d-489f-b459-eaa8d04fd49f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.887989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-c05ca3f2-f63d-489f-b459-eaa8d04fd49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:32.904976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1270/2544] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:32.919116 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729f0c-96e1-42e5-9b4c-33ef614240e9 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:32.920896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-70729f0c-96e1-42e5-9b4c-33ef614240e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:32.959896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:33.000503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729f0c-96e1-42e5-9b4c-33ef614240e9 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:33.009962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca3f2-f63d-489f-b459-eaa8d04fd49f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:33.009962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:33.009962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.009962 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.010503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.021534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:33.023054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:33.033538 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1275/2545] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:33.068658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:33.068658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.068658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.068658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.071018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:33.073924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:33.133989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1084f-911f-4ea5-8d8d-55075ee27ef5 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:33.153558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:33.155867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.156154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.156428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] PATH_INFO: `/v3/projects/5954907b48274311923967ccfed1ff42` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.159428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5954907b48274311923967ccfed1ff42)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:33.161405 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:33.198641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:33.200380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:33.223519 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1271/2546] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:33.335923 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5954907b48274311923967ccfed1ff42', 'request_id': 'req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.338775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:33.341042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:33.359565 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4b85a-a886-41b1-8492-02352585b32e service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:33.362400 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5954907b48274311923967ccfed1ff42', 'request_id': 'req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.421544 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb5b1a-16c4-4076-bc01-f0e4a00ff24e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:33.422352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5b1a-16c4-4076-bc01-f0e4a00ff24e service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.422731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5b1a-16c4-4076-bc01-f0e4a00ff24e service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.423071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5b1a-16c4-4076-bc01-f0e4a00ff24e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.425084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-dfcb5b1a-16c4-4076-bc01-f0e4a00ff24e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:33.461321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5954907b48274311923967ccfed1ff42', 'request_id': 'req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.476970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] The token cache is being invalidate because project 5954907b48274311923967ccfed1ff42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:33.478128 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.480073 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-4f402e91-2af0-4c26-af4f-1c1ce54f60c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.486653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1276/2547] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:33 2022] DELETE /identity/v3/projects/5954907b48274311923967ccfed1ff42 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:33.489297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:33.491570 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b90592-0e2a-4240-8bb0-5f449fa6c370 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.492377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b90592-0e2a-4240-8bb0-5f449fa6c370 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.492919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b90592-0e2a-4240-8bb0-5f449fa6c370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.510485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb5b1a-16c4-4076-bc01-f0e4a00ff24e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:33.512625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb5b1a-16c4-4076-bc01-f0e4a00ff24e service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:33.525509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1272/2548] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:33.527379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-05b90592-0e2a-4240-8bb0-5f449fa6c370 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:33.529251 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-05b90592-0e2a-4240-8bb0-5f449fa6c370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:33.632677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1277/2549] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:33.640649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78fd04-a50e-4a4e-bd33-3344ba968f39 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.640961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78fd04-a50e-4a4e-bd33-3344ba968f39 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.641268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78fd04-a50e-4a4e-bd33-3344ba968f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.662133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b90592-0e2a-4240-8bb0-5f449fa6c370 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:33.663552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-05b90592-0e2a-4240-8bb0-5f449fa6c370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:33.670207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-8f78fd04-a50e-4a4e-bd33-3344ba968f39 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:33.671536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8f78fd04-a50e-4a4e-bd33-3344ba968f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:33.680285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b90592-0e2a-4240-8bb0-5f449fa6c370 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:33.684145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1273/2550] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:33.690297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78fd04-a50e-4a4e-bd33-3344ba968f39 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:33.691984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:33.692873 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.693421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.693874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] PATH_INFO: `/v3/projects/fb4e8cf9b2bc4ef489b53b84fb748277` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.695308 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb4e8cf9b2bc4ef489b53b84fb748277)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:33.698239 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:33.717436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78fd04-a50e-4a4e-bd33-3344ba968f39 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:33.722736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:33.723359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.723637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.723907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.724596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:33.724918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:33.726646 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:33.744526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1274/2551] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:33.746008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:33.756046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59bbf9-f230-4336-a45c-f720f33551c7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:33.761376 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76e76-372c-405d-b3ff-0affe611f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:33.761987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76e76-372c-405d-b3ff-0affe611f570 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:33.762365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76e76-372c-405d-b3ff-0affe611f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:33.762677 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76e76-372c-405d-b3ff-0affe611f570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:33.763706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b76e76-372c-405d-b3ff-0affe611f570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:33.765943 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b76e76-372c-405d-b3ff-0affe611f570 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:33.840736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb4e8cf9b2bc4ef489b53b84fb748277', 'request_id': 'req-93ef7bc7-948e-452f-bd9b-6220ba989cfb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.846588 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb4e8cf9b2bc4ef489b53b84fb748277', 'request_id': 'req-93ef7bc7-948e-452f-bd9b-6220ba989cfb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.919790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1275/2552] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:33 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:33.923605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76e76-372c-405d-b3ff-0affe611f570 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:33.941068 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb4e8cf9b2bc4ef489b53b84fb748277', 'request_id': 'req-93ef7bc7-948e-452f-bd9b-6220ba989cfb'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.960564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] The token cache is being invalidate because project fb4e8cf9b2bc4ef489b53b84fb748277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:33.960942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.961606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:33.964503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1278/2553] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:33 2022] DELETE /identity/v3/projects/fb4e8cf9b2bc4ef489b53b84fb748277 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:33.970661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:33.973682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:34.011684 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76e76-372c-405d-b3ff-0affe611f570 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.016839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.017605 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.017953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.018292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.019254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.021530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.038943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:34.058954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef7bc7-948e-452f-bd9b-6220ba989cfb admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.064226 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.065024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.065307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.065581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] PATH_INFO: `/v3/users/07e6757ee10d47f8a7dca9a6b97aaa7d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.066870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e6757ee10d47f8a7dca9a6b97aaa7d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.068722 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.108673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:34.117530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1276/2554] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:33 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:34.118865 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:34.120981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:34.139275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df9127-a21a-423a-833b-ff46a43e2e27 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.144789 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aa6a9-f803-40b7-98dd-6b519b3231ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.145660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aa6a9-f803-40b7-98dd-6b519b3231ac admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.146265 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aa6a9-f803-40b7-98dd-6b519b3231ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.146366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aa6a9-f803-40b7-98dd-6b519b3231ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.147426 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385aa6a9-f803-40b7-98dd-6b519b3231ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.149928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385aa6a9-f803-40b7-98dd-6b519b3231ac admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.161211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1277/2555] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:34.164710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aa6a9-f803-40b7-98dd-6b519b3231ac admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:34.175700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aa6a9-f803-40b7-98dd-6b519b3231ac admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.181775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25831218-29e3-4e0b-9893-4f73ce26e3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.182558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25831218-29e3-4e0b-9893-4f73ce26e3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.182920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25831218-29e3-4e0b-9893-4f73ce26e3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.183197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25831218-29e3-4e0b-9893-4f73ce26e3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.183895 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25831218-29e3-4e0b-9893-4f73ce26e3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.185547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25831218-29e3-4e0b-9893-4f73ce26e3ee admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.198151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1278/2556] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:34.202258 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25831218-29e3-4e0b-9893-4f73ce26e3ee admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:34.213670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25831218-29e3-4e0b-9893-4f73ce26e3ee admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.225034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f99a-66fc-4804-8171-7fd6ef74a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.225811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f99a-66fc-4804-8171-7fd6ef74a6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.226099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f99a-66fc-4804-8171-7fd6ef74a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.226383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f99a-66fc-4804-8171-7fd6ef74a6b6 admin admin] PATH_INFO: `/v3/projects/2871532097a446038c23ec13e76ba086/users/970ca1a08c3f42ce8c9950b6b7ed627c/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.245310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978f99a-66fc-4804-8171-7fd6ef74a6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2871532097a446038c23ec13e76ba086, user_id=970ca1a08c3f42ce8c9950b6b7ed627c, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.250395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978f99a-66fc-4804-8171-7fd6ef74a6b6 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.285605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e6757ee10d47f8a7dca9a6b97aaa7d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:34.293992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e6757ee10d47f8a7dca9a6b97aaa7d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:34.341808 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1279/2557] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:34 2022] PUT /identity/v3/projects/2871532097a446038c23ec13e76ba086/users/970ca1a08c3f42ce8c9950b6b7ed627c/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:34.354822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d9f1-c2f0-43da-9757-64e2724c4a38 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.355271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d9f1-c2f0-43da-9757-64e2724c4a38 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.355386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d9f1-c2f0-43da-9757-64e2724c4a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.374427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e6757ee10d47f8a7dca9a6b97aaa7d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:34.388114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ced4d9f1-c2f0-43da-9757-64e2724c4a38 None None] MFA Rules not processed for user `970ca1a08c3f42ce8c9950b6b7ed627c`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:34.389469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ced4d9f1-c2f0-43da-9757-64e2724c4a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:34.396545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e6757ee10d47f8a7dca9a6b97aaa7d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:34.397793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e6757ee10d47f8a7dca9a6b97aaa7d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:34.407689 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1279/2558] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:33 2022] DELETE /identity/v3/users/07e6757ee10d47f8a7dca9a6b97aaa7d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:34.470353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1280/2559] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:34.475041 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:34.476593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:34.565858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426062f-1e08-4325-bcea-e4a8bf215a58 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.570705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.571487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.571772 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.572081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.572746 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.574707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.678599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:34.706297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1280/2560] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:34 2022] POST /identity/v3/projects => generated 389 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:34.707366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d9f1-c2f0-43da-9757-64e2724c4a38 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:34.772271 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d9f1-c2f0-43da-9757-64e2724c4a38 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.831612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120027-279a-43ad-84c3-8033974ab1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.832233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120027-279a-43ad-84c3-8033974ab1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.835461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120027-279a-43ad-84c3-8033974ab1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.835461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120027-279a-43ad-84c3-8033974ab1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.835461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe120027-279a-43ad-84c3-8033974ab1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.835461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe120027-279a-43ad-84c3-8033974ab1c6 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.924872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:34.926627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:34.940174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1281/2561] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:34 2022] POST /identity/v3/users => generated 301 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:34.942011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87d22b-b9e5-4b3a-91d9-6839eb3dcb81 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.943923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120027-279a-43ad-84c3-8033974ab1c6 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:34.949747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.950698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.951007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.951323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] PATH_INFO: `/v3/projects/64026fe8397546a7a6a7ebb8943930b1` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.952595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64026fe8397546a7a6a7ebb8943930b1)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.954822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.962328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120027-279a-43ad-84c3-8033974ab1c6 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.965359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9946b90-6780-4a4e-b7b9-ab5ac3c6fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:34.966042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9946b90-6780-4a4e-b7b9-ab5ac3c6fae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:34.966322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9946b90-6780-4a4e-b7b9-ab5ac3c6fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:34.966592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9946b90-6780-4a4e-b7b9-ab5ac3c6fae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:34.967313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9946b90-6780-4a4e-b7b9-ab5ac3c6fae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:34.968971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9946b90-6780-4a4e-b7b9-ab5ac3c6fae7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:34.983095 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1282/2562] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:34.984149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9946b90-6780-4a4e-b7b9-ab5ac3c6fae7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:34.994915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9946b90-6780-4a4e-b7b9-ab5ac3c6fae7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:34.999571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196257c-1d70-423c-afa8-e7774ea97a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.000217 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196257c-1d70-423c-afa8-e7774ea97a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.000501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196257c-1d70-423c-afa8-e7774ea97a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.000777 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196257c-1d70-423c-afa8-e7774ea97a8d admin admin] PATH_INFO: `/v3/projects/f5a51ddfcd7d4d158cd461bb9d60c8d3/users/f4ac72838e2d48e7811f755264dea51d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.016960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196257c-1d70-423c-afa8-e7774ea97a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a51ddfcd7d4d158cd461bb9d60c8d3, user_id=f4ac72838e2d48e7811f755264dea51d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.019709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196257c-1d70-423c-afa8-e7774ea97a8d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.116021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1283/2563] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:34 2022] PUT /identity/v3/projects/f5a51ddfcd7d4d158cd461bb9d60c8d3/users/f4ac72838e2d48e7811f755264dea51d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:35.120466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196257c-1d70-423c-afa8-e7774ea97a8d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.124714 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64026fe8397546a7a6a7ebb8943930b1', 'request_id': 'req-01473bd8-6956-49e4-8332-2c3993c8b91c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:35.130326 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64026fe8397546a7a6a7ebb8943930b1', 'request_id': 'req-01473bd8-6956-49e4-8332-2c3993c8b91c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:35.186252 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196257c-1d70-423c-afa8-e7774ea97a8d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.203646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64026fe8397546a7a6a7ebb8943930b1', 'request_id': 'req-01473bd8-6956-49e4-8332-2c3993c8b91c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:35.216861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] The token cache is being invalidate because project 64026fe8397546a7a6a7ebb8943930b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:35.217182 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:35.217848 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-01473bd8-6956-49e4-8332-2c3993c8b91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:35.219366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1281/2564] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:34 2022] DELETE /identity/v3/projects/64026fe8397546a7a6a7ebb8943930b1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:35.228169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89452-d8ab-4879-b98f-e05a55f527f4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.228542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89452-d8ab-4879-b98f-e05a55f527f4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.228808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89452-d8ab-4879-b98f-e05a55f527f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.247158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9415546-4dcf-4876-8d61-4b8b0b9e8ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.247787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415546-4dcf-4876-8d61-4b8b0b9e8ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.248062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415546-4dcf-4876-8d61-4b8b0b9e8ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.248377 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415546-4dcf-4876-8d61-4b8b0b9e8ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.248919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-e8d89452-d8ab-4879-b98f-e05a55f527f4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:35.249102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9415546-4dcf-4876-8d61-4b8b0b9e8ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.250151 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e8d89452-d8ab-4879-b98f-e05a55f527f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:35.250708 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9415546-4dcf-4876-8d61-4b8b0b9e8ea0 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.258203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1282/2565] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:35.261155 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1284/2566] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:35.265096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d89452-d8ab-4879-b98f-e05a55f527f4 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.265837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738b07-f6d6-430d-910d-4b1a47eb6394 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.266122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738b07-f6d6-430d-910d-4b1a47eb6394 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.266393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738b07-f6d6-430d-910d-4b1a47eb6394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.266512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e8d89452-d8ab-4879-b98f-e05a55f527f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:35.279107 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d89452-d8ab-4879-b98f-e05a55f527f4 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.284451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd64ed-35d3-47ae-93fb-08945ebe33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.285147 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd64ed-35d3-47ae-93fb-08945ebe33f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.285552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd64ed-35d3-47ae-93fb-08945ebe33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.285832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd64ed-35d3-47ae-93fb-08945ebe33f2 admin admin] PATH_INFO: `/v3/projects/f5a51ddfcd7d4d158cd461bb9d60c8d3/users/f4ac72838e2d48e7811f755264dea51d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.286060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-65738b07-f6d6-430d-910d-4b1a47eb6394 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:35.287589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-65738b07-f6d6-430d-910d-4b1a47eb6394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:35.287777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd64ed-35d3-47ae-93fb-08945ebe33f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a51ddfcd7d4d158cd461bb9d60c8d3, user_id=f4ac72838e2d48e7811f755264dea51d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.291113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd64ed-35d3-47ae-93fb-08945ebe33f2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.296801 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1285/2567] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:35.301154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65738b07-f6d6-430d-910d-4b1a47eb6394 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.301630 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1283/2568] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:35 2022] PUT /identity/v3/projects/f5a51ddfcd7d4d158cd461bb9d60c8d3/users/f4ac72838e2d48e7811f755264dea51d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:35.311392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65738b07-f6d6-430d-910d-4b1a47eb6394 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.312906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af58f2-58ec-4b9a-a479-d8e91037db59 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.313253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af58f2-58ec-4b9a-a479-d8e91037db59 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.314973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:35.315359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af58f2-58ec-4b9a-a479-d8e91037db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.343480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-55af58f2-58ec-4b9a-a479-d8e91037db59 None None] MFA Rules not processed for user `f4ac72838e2d48e7811f755264dea51d`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:35.348029 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-55af58f2-58ec-4b9a-a479-d8e91037db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:35.371400 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.372086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.372372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.372644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.374547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:35.374547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.386185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.401985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:35.408693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1286/2569] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:31:35.414150 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.442201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10af731-d6bd-4269-b6fc-447c2d0c96ab admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.442394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1284/2570] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:35.449065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad7c58-cfb9-4ca8-a542-33f747f892b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.449931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad7c58-cfb9-4ca8-a542-33f747f892b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.451075 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad7c58-cfb9-4ca8-a542-33f747f892b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.451408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad7c58-cfb9-4ca8-a542-33f747f892b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.455996 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad7c58-cfb9-4ca8-a542-33f747f892b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.456495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af58f2-58ec-4b9a-a479-d8e91037db59 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.456495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-55af58f2-58ec-4b9a-a479-d8e91037db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:35.456645 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad7c58-cfb9-4ca8-a542-33f747f892b4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.530105 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af58f2-58ec-4b9a-a479-d8e91037db59 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.533729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4e84-d646-45b3-8b03-5a25a905c0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.534343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4e84-d646-45b3-8b03-5a25a905c0dc service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.534626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4e84-d646-45b3-8b03-5a25a905c0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.534897 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4e84-d646-45b3-8b03-5a25a905c0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.545697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4e84-d646-45b3-8b03-5a25a905c0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.547150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4e84-d646-45b3-8b03-5a25a905c0dc service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.557235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1285/2571] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:35.631416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1287/2572] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:35 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:35.636863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4e84-d646-45b3-8b03-5a25a905c0dc service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.659698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4e84-d646-45b3-8b03-5a25a905c0dc service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.726743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad7c58-cfb9-4ca8-a542-33f747f892b4 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.740466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d638f-420b-422b-83d7-78c15432bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.741296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d638f-420b-422b-83d7-78c15432bd20 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.741577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d638f-420b-422b-83d7-78c15432bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.741858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d638f-420b-422b-83d7-78c15432bd20 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.742618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d638f-420b-422b-83d7-78c15432bd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.745680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d638f-420b-422b-83d7-78c15432bd20 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.803220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad7c58-cfb9-4ca8-a542-33f747f892b4 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.810328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.811132 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.811596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.811906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] PATH_INFO: `/v3/users/970ca1a08c3f42ce8c9950b6b7ed627c` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.813191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=970ca1a08c3f42ce8c9950b6b7ed627c)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.815716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.845598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:35.852947 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1286/2573] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:35 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:35.854428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d638f-420b-422b-83d7-78c15432bd20 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.865860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d638f-420b-422b-83d7-78c15432bd20 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.875371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597a61b-9cbd-47ca-bf27-8e4c1b1f3cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.877950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a61b-9cbd-47ca-bf27-8e4c1b1f3cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.877950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a61b-9cbd-47ca-bf27-8e4c1b1f3cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.877950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a61b-9cbd-47ca-bf27-8e4c1b1f3cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.878515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597a61b-9cbd-47ca-bf27-8e4c1b1f3cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.880027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597a61b-9cbd-47ca-bf27-8e4c1b1f3cf3 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.894737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1287/2574] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:35.897445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:35.898660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597a61b-9cbd-47ca-bf27-8e4c1b1f3cf3 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.911441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597a61b-9cbd-47ca-bf27-8e4c1b1f3cf3 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.918778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58890fed-9a05-490b-bbad-55d40d093cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.920259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58890fed-9a05-490b-bbad-55d40d093cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.920259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58890fed-9a05-490b-bbad-55d40d093cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.920259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58890fed-9a05-490b-bbad-55d40d093cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.920701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58890fed-9a05-490b-bbad-55d40d093cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.922347 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58890fed-9a05-490b-bbad-55d40d093cc4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:35.934052 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1288/2575] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:35.938331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58890fed-9a05-490b-bbad-55d40d093cc4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:35.948276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58890fed-9a05-490b-bbad-55d40d093cc4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:35.952981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c9ee-6b83-4872-b8d1-40c41d1a41f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:35.953708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c9ee-6b83-4872-b8d1-40c41d1a41f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:35.954060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c9ee-6b83-4872-b8d1-40c41d1a41f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:35.954404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c9ee-6b83-4872-b8d1-40c41d1a41f3 admin admin] PATH_INFO: `/v3/projects/9ae7a5734b7f4969bb5c76f96abbe78f/users/05a8dbc06330405db15dcfbfc6e55b2b/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:35.970732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83c9ee-6b83-4872-b8d1-40c41d1a41f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae7a5734b7f4969bb5c76f96abbe78f, user_id=05a8dbc06330405db15dcfbfc6e55b2b, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:35.973430 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83c9ee-6b83-4872-b8d1-40c41d1a41f3 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:36.053278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1289/2576] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:35 2022] PUT /identity/v3/projects/9ae7a5734b7f4969bb5c76f96abbe78f/users/05a8dbc06330405db15dcfbfc6e55b2b/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:36.062403 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970ca1a08c3f42ce8c9950b6b7ed627c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.063060 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970ca1a08c3f42ce8c9950b6b7ed627c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.063904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970ca1a08c3f42ce8c9950b6b7ed627c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.064964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d2b6e-9971-49b1-a37e-138e59b254f6 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:36.065253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d2b6e-9971-49b1-a37e-138e59b254f6 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:36.065531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d2b6e-9971-49b1-a37e-138e59b254f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:36.076671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970ca1a08c3f42ce8c9950b6b7ed627c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.094528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d01d2b6e-9971-49b1-a37e-138e59b254f6 None None] MFA Rules not processed for user `05a8dbc06330405db15dcfbfc6e55b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:36.095902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d01d2b6e-9971-49b1-a37e-138e59b254f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:36.165655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1290/2577] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:36.168175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7a0ce183-bf2f-4f5a-af64-313e7bc165ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970ca1a08c3f42ce8c9950b6b7ed627c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.177742 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d2b6e-9971-49b1-a37e-138e59b254f6 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:36.179330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d01d2b6e-9971-49b1-a37e-138e59b254f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:36.186163 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1288/2578] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:35 2022] DELETE /identity/v3/users/970ca1a08c3f42ce8c9950b6b7ed627c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:36.188504 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3abf3-5add-4748-a5ef-1be0fe9339b7 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:36.188843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3abf3-5add-4748-a5ef-1be0fe9339b7 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:36.189208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3abf3-5add-4748-a5ef-1be0fe9339b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:36.209564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-baa3abf3-5add-4748-a5ef-1be0fe9339b7 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:36.210552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-baa3abf3-5add-4748-a5ef-1be0fe9339b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:36.258367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d2b6e-9971-49b1-a37e-138e59b254f6 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:36.285109 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1289/2579] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:36.296147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3abf3-5add-4748-a5ef-1be0fe9339b7 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:36.297700 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-baa3abf3-5add-4748-a5ef-1be0fe9339b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:36.311963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:36.317409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:36.317409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:36.317409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:36.351954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:36.356534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3abf3-5add-4748-a5ef-1be0fe9339b7 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:36.360358 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:36.361189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:36.361574 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:36.361946 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:36.371511 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:36.374738 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:36.374896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:36.375018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:36.383128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1290/2580] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:36.383377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1291/2581] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:36.406675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:36.408169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:36.420920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:36.447329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32ecf5-b1b7-47b4-9e1e-00a026ff56e6 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:36.452685 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:36.453599 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:36.454535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:36.454683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] PATH_INFO: `/v3/users/05a8dbc06330405db15dcfbfc6e55b2b` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:36.457061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a8dbc06330405db15dcfbfc6e55b2b)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:36.459435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:36.776100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:36.779396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a8dbc06330405db15dcfbfc6e55b2b'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.784110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a8dbc06330405db15dcfbfc6e55b2b'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.784110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a8dbc06330405db15dcfbfc6e55b2b'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.797412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a8dbc06330405db15dcfbfc6e55b2b'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.861358 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:36.862863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:36.878269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5fa8-033b-49cb-b5fe-70dc6d9548fe service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:36.883171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:36.885880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:36.885880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:36.885880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] PATH_INFO: `/v3/projects/2871532097a446038c23ec13e76ba086` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:36.885880 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2871532097a446038c23ec13e76ba086)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:36.887749 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:36.904555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1282d732-57b5-4ccd-a17a-8d57fd874410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a8dbc06330405db15dcfbfc6e55b2b'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:36.919908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1291/2582] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:36 2022] DELETE /identity/v3/users/05a8dbc06330405db15dcfbfc6e55b2b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:36.929844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498dae-29b1-4923-97c2-0d938052d21d None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:36.930123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498dae-29b1-4923-97c2-0d938052d21d None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:36.930883 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498dae-29b1-4923-97c2-0d938052d21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:36.953076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-03498dae-29b1-4923-97c2-0d938052d21d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:36.954335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-03498dae-29b1-4923-97c2-0d938052d21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:37.003215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2871532097a446038c23ec13e76ba086', 'request_id': 'req-9e76abfa-f611-4dff-ae52-66679e1a9f8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.010556 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2871532097a446038c23ec13e76ba086', 'request_id': 'req-9e76abfa-f611-4dff-ae52-66679e1a9f8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.015199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1292/2583] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:37.025630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03498dae-29b1-4923-97c2-0d938052d21d None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:37.026954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-03498dae-29b1-4923-97c2-0d938052d21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:37.064906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2871532097a446038c23ec13e76ba086', 'request_id': 'req-9e76abfa-f611-4dff-ae52-66679e1a9f8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.078504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] The token cache is being invalidate because project 2871532097a446038c23ec13e76ba086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:37.078797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.079441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.081126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1292/2584] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:36 2022] DELETE /identity/v3/projects/2871532097a446038c23ec13e76ba086 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:37.084937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03498dae-29b1-4923-97c2-0d938052d21d None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:37.085227 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:37.086654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:37.103186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:37.136505 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:37.137169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:37.137442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:37.137714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:37.139507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:37.152235 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:37.152731 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76abfa-f611-4dff-ae52-66679e1a9f8b admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:37.153689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:37.157514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:37.158161 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:37.158451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:37.158759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] PATH_INFO: `/v3/users/f4ac72838e2d48e7811f755264dea51d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:37.160076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ac72838e2d48e7811f755264dea51d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:37.162058 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:37.165581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1293/2585] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:37.372613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:37.378963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ac72838e2d48e7811f755264dea51d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.386364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ac72838e2d48e7811f755264dea51d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.460391 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ac72838e2d48e7811f755264dea51d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.473526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ac72838e2d48e7811f755264dea51d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.474219 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ac72838e2d48e7811f755264dea51d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.481324 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1293/2586] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:37 2022] DELETE /identity/v3/users/f4ac72838e2d48e7811f755264dea51d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:37.673000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:37.673000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:37.695186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9396628-c66c-420e-9750-a731a05eefc8 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:37.778978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:37.780127 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:37.780675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:37.780675 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] PATH_INFO: `/v3/projects/9ae7a5734b7f4969bb5c76f96abbe78f` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:37.781866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae7a5734b7f4969bb5c76f96abbe78f)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:37.784812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:37.911879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae7a5734b7f4969bb5c76f96abbe78f', 'request_id': 'req-81c566f6-3449-493f-b302-309a83a4005d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.917800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae7a5734b7f4969bb5c76f96abbe78f', 'request_id': 'req-81c566f6-3449-493f-b302-309a83a4005d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:37.983453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:37.985005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:38.000526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64249a3a-ea82-4851-8e2a-bf89e36575e7 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.032160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae7a5734b7f4969bb5c76f96abbe78f', 'request_id': 'req-81c566f6-3449-493f-b302-309a83a4005d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:38.045475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] The token cache is being invalidate because project 9ae7a5734b7f4969bb5c76f96abbe78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:38.045762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:38.046429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-81c566f6-3449-493f-b302-309a83a4005d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:38.048341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1294/2587] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:37 2022] DELETE /identity/v3/projects/9ae7a5734b7f4969bb5c76f96abbe78f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:38.057077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db465f-c345-4155-a193-84c52113cf4b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.057385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db465f-c345-4155-a193-84c52113cf4b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.057615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db465f-c345-4155-a193-84c52113cf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.070460 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.071389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.072087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.072684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] PATH_INFO: `/v3/projects/f5a51ddfcd7d4d158cd461bb9d60c8d3` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.073884 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a51ddfcd7d4d158cd461bb9d60c8d3)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.075822 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.085921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-67db465f-c345-4155-a193-84c52113cf4b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:38.087893 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-67db465f-c345-4155-a193-84c52113cf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:38.101611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1295/2588] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:38.118686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743acc3-fea7-4486-884f-e5f2dcaf14b6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.118995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743acc3-fea7-4486-884f-e5f2dcaf14b6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.119260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743acc3-fea7-4486-884f-e5f2dcaf14b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.150828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f743acc3-fea7-4486-884f-e5f2dcaf14b6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:38.152049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f743acc3-fea7-4486-884f-e5f2dcaf14b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:38.160191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1296/2589] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:38.164334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743acc3-fea7-4486-884f-e5f2dcaf14b6 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.174179 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743acc3-fea7-4486-884f-e5f2dcaf14b6 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.179198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.179803 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.180206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.181205 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.181999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:38.182306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.183959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.196390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1297/2590] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:31:38.200486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.210121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7f4ad-6d33-424d-a2b6-14563d73597e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.214959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a9e2b-750f-4bb3-b616-89df8b8421a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.215557 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a9e2b-750f-4bb3-b616-89df8b8421a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.215838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a9e2b-750f-4bb3-b616-89df8b8421a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.216112 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a9e2b-750f-4bb3-b616-89df8b8421a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.216765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a9e2b-750f-4bb3-b616-89df8b8421a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.218676 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a9e2b-750f-4bb3-b616-89df8b8421a4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.234534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a51ddfcd7d4d158cd461bb9d60c8d3', 'request_id': 'req-6974d028-b8dd-4b83-8f0a-487a3238311d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:38.240609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a51ddfcd7d4d158cd461bb9d60c8d3', 'request_id': 'req-6974d028-b8dd-4b83-8f0a-487a3238311d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:38.314206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1298/2591] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:38.318395 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a9e2b-750f-4bb3-b616-89df8b8421a4 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.324372 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:38.339077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a51ddfcd7d4d158cd461bb9d60c8d3', 'request_id': 'req-6974d028-b8dd-4b83-8f0a-487a3238311d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:38.351482 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] The token cache is being invalidate because project f5a51ddfcd7d4d158cd461bb9d60c8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:38.351818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:38.353256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6974d028-b8dd-4b83-8f0a-487a3238311d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:38.355008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1294/2592] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:37 2022] DELETE /identity/v3/projects/f5a51ddfcd7d4d158cd461bb9d60c8d3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:38.359571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6a59-bb02-4f41-aeef-87dc6bbe21b5 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.359854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6a59-bb02-4f41-aeef-87dc6bbe21b5 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.360132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6a59-bb02-4f41-aeef-87dc6bbe21b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.380581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-eedd6a59-bb02-4f41-aeef-87dc6bbe21b5 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:38.381996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-eedd6a59-bb02-4f41-aeef-87dc6bbe21b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:38.384868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a9e2b-750f-4bb3-b616-89df8b8421a4 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.389472 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.390085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.390365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.390632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.390889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1295/2593] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:38.393350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.395414 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.399413 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce8755-06a9-4d48-95f0-115f1c058424 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.399621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce8755-06a9-4d48-95f0-115f1c058424 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.400302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce8755-06a9-4d48-95f0-115f1c058424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.423065 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d0ce8755-06a9-4d48-95f0-115f1c058424 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:38.424287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d0ce8755-06a9-4d48-95f0-115f1c058424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:38.432620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1296/2594] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:38.436495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce8755-06a9-4d48-95f0-115f1c058424 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.445828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce8755-06a9-4d48-95f0-115f1c058424 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.451208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.451824 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.452107 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.452379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.453116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:38.453424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.455019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.470432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1297/2595] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:31:38.474906 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.486462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351b2e7-3cd6-4c3e-b564-9eb8f5bdb744 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.491712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee76e4-93da-4a5d-ae56-5e61ab22c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.492265 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee76e4-93da-4a5d-ae56-5e61ab22c0cd admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.492627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee76e4-93da-4a5d-ae56-5e61ab22c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.493377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee76e4-93da-4a5d-ae56-5e61ab22c0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.493483 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1299/2596] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:38.496727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee76e4-93da-4a5d-ae56-5e61ab22c0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.497793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.498694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee76e4-93da-4a5d-ae56-5e61ab22c0cd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.499790 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:38.513051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95194cd3-2631-4435-8ae6-a6ef28bef967 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.517867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefc74b-6b28-43e8-b2a4-6beaf2199d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.518530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefc74b-6b28-43e8-b2a4-6beaf2199d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.522815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefc74b-6b28-43e8-b2a4-6beaf2199d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.522815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefc74b-6b28-43e8-b2a4-6beaf2199d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.522815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefc74b-6b28-43e8-b2a4-6beaf2199d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.522815 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefc74b-6b28-43e8-b2a4-6beaf2199d6e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.532327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1300/2597] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:38.536145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefc74b-6b28-43e8-b2a4-6beaf2199d6e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.551654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefc74b-6b28-43e8-b2a4-6beaf2199d6e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.551654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54bdfe-1f67-4308-871e-7239a7ce8e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.551654 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54bdfe-1f67-4308-871e-7239a7ce8e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.552033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54bdfe-1f67-4308-871e-7239a7ce8e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.552269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54bdfe-1f67-4308-871e-7239a7ce8e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.553008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54bdfe-1f67-4308-871e-7239a7ce8e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.554643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54bdfe-1f67-4308-871e-7239a7ce8e1e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.565500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1301/2598] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:38.569642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54bdfe-1f67-4308-871e-7239a7ce8e1e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.579567 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54bdfe-1f67-4308-871e-7239a7ce8e1e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.584120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623205b8-a73c-4e47-aedf-3d6f3fc35ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.584776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623205b8-a73c-4e47-aedf-3d6f3fc35ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.585083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623205b8-a73c-4e47-aedf-3d6f3fc35ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.585356 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623205b8-a73c-4e47-aedf-3d6f3fc35ff8 admin admin] PATH_INFO: `/v3/projects/6352763e6edd4801813eb59cad752e0a/users/ef4a60c04c3246b69921d251641bdef8/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.597193 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:38.602037 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623205b8-a73c-4e47-aedf-3d6f3fc35ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6352763e6edd4801813eb59cad752e0a, user_id=ef4a60c04c3246b69921d251641bdef8, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.605332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1298/2599] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:38.608629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623205b8-a73c-4e47-aedf-3d6f3fc35ff8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.609493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee76e4-93da-4a5d-ae56-5e61ab22c0cd admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.675578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee76e4-93da-4a5d-ae56-5e61ab22c0cd admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.682515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332e6bf-5d17-4707-8839-55da806640d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.683485 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332e6bf-5d17-4707-8839-55da806640d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.684034 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332e6bf-5d17-4707-8839-55da806640d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.685364 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332e6bf-5d17-4707-8839-55da806640d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.686649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332e6bf-5d17-4707-8839-55da806640d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.690342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332e6bf-5d17-4707-8839-55da806640d9 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.711261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1302/2600] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:38 2022] PUT /identity/v3/projects/6352763e6edd4801813eb59cad752e0a/users/ef4a60c04c3246b69921d251641bdef8/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:38.779673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccf91-4641-49c2-87b4-a9a3c28b1f81 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.779954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccf91-4641-49c2-87b4-a9a3c28b1f81 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.780220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccf91-4641-49c2-87b4-a9a3c28b1f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.809627 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a75ccf91-4641-49c2-87b4-a9a3c28b1f81 None None] MFA Rules not processed for user `ef4a60c04c3246b69921d251641bdef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:38.810746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a75ccf91-4641-49c2-87b4-a9a3c28b1f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:38.817224 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1299/2601] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:38.818110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332e6bf-5d17-4707-8839-55da806640d9 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.829704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332e6bf-5d17-4707-8839-55da806640d9 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.881119 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1303/2602] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:38.887876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f50392-5c59-48d4-a36a-fa1ed9c89f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.888647 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f50392-5c59-48d4-a36a-fa1ed9c89f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.888964 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f50392-5c59-48d4-a36a-fa1ed9c89f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.889068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ccf91-4641-49c2-87b4-a9a3c28b1f81 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.889246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f50392-5c59-48d4-a36a-fa1ed9c89f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.889949 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f50392-5c59-48d4-a36a-fa1ed9c89f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.890302 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a75ccf91-4641-49c2-87b4-a9a3c28b1f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:38.891581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f50392-5c59-48d4-a36a-fa1ed9c89f32 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.904233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1300/2603] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:38.908026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f50392-5c59-48d4-a36a-fa1ed9c89f32 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.919146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f50392-5c59-48d4-a36a-fa1ed9c89f32 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.924727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653720c-99a5-4aa5-938c-82ce216eda19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.925144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653720c-99a5-4aa5-938c-82ce216eda19 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.925432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653720c-99a5-4aa5-938c-82ce216eda19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.925699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653720c-99a5-4aa5-938c-82ce216eda19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.926467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653720c-99a5-4aa5-938c-82ce216eda19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.927982 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653720c-99a5-4aa5-938c-82ce216eda19 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.940271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1301/2604] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:38.941518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:38.944422 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653720c-99a5-4aa5-938c-82ce216eda19 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:38.958102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ccf91-4641-49c2-87b4-a9a3c28b1f81 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.959600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653720c-99a5-4aa5-938c-82ce216eda19 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:38.962707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.963335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.963608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.963883 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.965876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a1913-486d-47bb-82ff-ae687d427481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:38.966542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1913-486d-47bb-82ff-ae687d427481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:38.966827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1913-486d-47bb-82ff-ae687d427481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:38.967528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1913-486d-47bb-82ff-ae687d427481 admin admin] PATH_INFO: `/v3/projects/f53d1f3c098849039d393c199dbbd7f3/users/e354803e951b45ec96589507e48328b3/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:38.973550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.975129 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:38.983509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a1913-486d-47bb-82ff-ae687d427481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53d1f3c098849039d393c199dbbd7f3, user_id=e354803e951b45ec96589507e48328b3, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:38.986144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1304/2605] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:38.989163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a1913-486d-47bb-82ff-ae687d427481 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:39.101322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:39.102729 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:39.116696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4543a-de1e-4dd4-a6d6-0061869a7feb service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:39.122098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:39.127990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.127990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.127990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] PATH_INFO: `/v3/users/c1c6a8e9097244d5868b4fe357e9b9da` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.127990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c6a8e9097244d5868b4fe357e9b9da)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:39.128416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1302/2606] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:38 2022] PUT /identity/v3/projects/f53d1f3c098849039d393c199dbbd7f3/users/e354803e951b45ec96589507e48328b3/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:39.128521 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:39.139465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cc556-5e2e-4d12-9a79-49166abe47fa None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.139861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cc556-5e2e-4d12-9a79-49166abe47fa None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.140213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cc556-5e2e-4d12-9a79-49166abe47fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.174296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-de6cc556-5e2e-4d12-9a79-49166abe47fa None None] MFA Rules not processed for user `e354803e951b45ec96589507e48328b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:39.175515 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-de6cc556-5e2e-4d12-9a79-49166abe47fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:39.224150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:39.257739 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1303/2607] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:39.258983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cc556-5e2e-4d12-9a79-49166abe47fa None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:39.260446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-de6cc556-5e2e-4d12-9a79-49166abe47fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:39.293839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c6a8e9097244d5868b4fe357e9b9da'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:39.295187 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c6a8e9097244d5868b4fe357e9b9da'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:39.295991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c6a8e9097244d5868b4fe357e9b9da'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:39.308942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c6a8e9097244d5868b4fe357e9b9da'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:39.318192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cc556-5e2e-4d12-9a79-49166abe47fa None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:39.322047 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:39.322514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.322791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.323061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.324823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:39.388462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:39.389934 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:39.400371 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1304/2608] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:39.401163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:39.402626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:39.403461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-662cd0d5-2325-47f9-9e99-e66fb29e1eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c6a8e9097244d5868b4fe357e9b9da'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:39.414198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcedfe2-f295-4333-aa87-1779166b50bf service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:39.419820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba603e3-ddc9-486a-9931-510f13793bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:39.420498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba603e3-ddc9-486a-9931-510f13793bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.420785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba603e3-ddc9-486a-9931-510f13793bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.421100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba603e3-ddc9-486a-9931-510f13793bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.421314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1305/2609] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:39 2022] DELETE /identity/v3/users/c1c6a8e9097244d5868b4fe357e9b9da => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:39.424551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba603e3-ddc9-486a-9931-510f13793bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:39.425718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236811-8488-404f-9a70-87c3408a46bc None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.426098 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236811-8488-404f-9a70-87c3408a46bc None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.426470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c236811-8488-404f-9a70-87c3408a46bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.426597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba603e3-ddc9-486a-9931-510f13793bfc admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:39.451864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3c236811-8488-404f-9a70-87c3408a46bc None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:39.453989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3c236811-8488-404f-9a70-87c3408a46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:39.525391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1306/2610] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:39.535212 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c236811-8488-404f-9a70-87c3408a46bc None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:39.536558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3c236811-8488-404f-9a70-87c3408a46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:39.554691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1305/2611] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:39 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:39.559436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba603e3-ddc9-486a-9931-510f13793bfc admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:39.614088 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c236811-8488-404f-9a70-87c3408a46bc None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:39.620925 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:39.640344 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba603e3-ddc9-486a-9931-510f13793bfc admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:39.679707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eed09-b89c-4219-ace3-fe4a0666d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:39.680920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eed09-b89c-4219-ace3-fe4a0666d659 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.682179 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eed09-b89c-4219-ace3-fe4a0666d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.682467 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eed09-b89c-4219-ace3-fe4a0666d659 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.683166 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eed09-b89c-4219-ace3-fe4a0666d659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:39.685269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eed09-b89c-4219-ace3-fe4a0666d659 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:39.686116 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02477431-04b2-4715-a6e6-5b1d510b8a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:39.687014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02477431-04b2-4715-a6e6-5b1d510b8a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.687500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02477431-04b2-4715-a6e6-5b1d510b8a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.687995 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02477431-04b2-4715-a6e6-5b1d510b8a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.701365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02477431-04b2-4715-a6e6-5b1d510b8a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:39.701662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:39.703711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02477431-04b2-4715-a6e6-5b1d510b8a55 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:39.715942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1307/2612] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:39.784790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1306/2613] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:39 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:39.788854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02477431-04b2-4715-a6e6-5b1d510b8a55 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:39.800238 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02477431-04b2-4715-a6e6-5b1d510b8a55 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:39.806629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9b5d-34b6-4afa-83aa-edfad7132ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:39.807272 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9b5d-34b6-4afa-83aa-edfad7132ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.807549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9b5d-34b6-4afa-83aa-edfad7132ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.807820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d9b5d-34b6-4afa-83aa-edfad7132ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.808804 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d9b5d-34b6-4afa-83aa-edfad7132ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:39.810430 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d9b5d-34b6-4afa-83aa-edfad7132ef4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:39.824274 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1308/2614] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:39.828341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eed09-b89c-4219-ace3-fe4a0666d659 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:39.840900 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eed09-b89c-4219-ace3-fe4a0666d659 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:39.850063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447374-68d2-4715-b63a-adad3c2d0469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:39.850063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447374-68d2-4715-b63a-adad3c2d0469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:39.850063 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447374-68d2-4715-b63a-adad3c2d0469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:39.850407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447374-68d2-4715-b63a-adad3c2d0469 admin admin] PATH_INFO: `/v3/projects/538e70db3acb4b0296a690b25878e9ba/users/906f1ed890784e9e8babd945e82ba6f7/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:39.867472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63447374-68d2-4715-b63a-adad3c2d0469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538e70db3acb4b0296a690b25878e9ba, user_id=906f1ed890784e9e8babd945e82ba6f7, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:39.871007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63447374-68d2-4715-b63a-adad3c2d0469 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:39.950856 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1307/2615] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:39 2022] PUT /identity/v3/projects/538e70db3acb4b0296a690b25878e9ba/users/906f1ed890784e9e8babd945e82ba6f7/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:39.954750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9b5d-34b6-4afa-83aa-edfad7132ef4 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:39.965698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d9b5d-34b6-4afa-83aa-edfad7132ef4 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:40.051129 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da215b1-16d5-4101-93f4-2ab70d9abfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:40.051760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da215b1-16d5-4101-93f4-2ab70d9abfbf admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:40.052038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da215b1-16d5-4101-93f4-2ab70d9abfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:40.052308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da215b1-16d5-4101-93f4-2ab70d9abfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:40.053033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da215b1-16d5-4101-93f4-2ab70d9abfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:40.054626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da215b1-16d5-4101-93f4-2ab70d9abfbf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:40.065876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1309/2616] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:40.070279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447374-68d2-4715-b63a-adad3c2d0469 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:40.083902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447374-68d2-4715-b63a-adad3c2d0469 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:40.090472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:40.091181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:40.092929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:40.092929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] PATH_INFO: `/v3/projects/538e70db3acb4b0296a690b25878e9ba/users/906f1ed890784e9e8babd945e82ba6f7/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:40.093939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=538e70db3acb4b0296a690b25878e9ba, user_id=906f1ed890784e9e8babd945e82ba6f7, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:40.096711 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:40.108919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1308/2617] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:40 2022] PUT /identity/v3/projects/538e70db3acb4b0296a690b25878e9ba/users/906f1ed890784e9e8babd945e82ba6f7/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:40.119648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126091-78c0-4c38-8386-6f21c59ca5c9 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:40.119993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126091-78c0-4c38-8386-6f21c59ca5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:40.120394 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126091-78c0-4c38-8386-6f21c59ca5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:40.150788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a7126091-78c0-4c38-8386-6f21c59ca5c9 None None] MFA Rules not processed for user `906f1ed890784e9e8babd945e82ba6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:40.152254 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a7126091-78c0-4c38-8386-6f21c59ca5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:40.226015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1310/2618] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:40.234321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:40.236078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:40.239741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7126091-78c0-4c38-8386-6f21c59ca5c9 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:40.247673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a7126091-78c0-4c38-8386-6f21c59ca5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:40.300564 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:40.312732 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b592bc-84e7-499e-988c-b803e352d9af admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:40.318396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:40.319051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:40.319535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:40.319697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] PATH_INFO: `/v3/projects/1c0780b7a636407393bd966cb0bf2c2f` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:40.322485 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0780b7a636407393bd966cb0bf2c2f)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:40.324511 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:40.338011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7126091-78c0-4c38-8386-6f21c59ca5c9 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:40.343287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861d14d-cdca-47f6-b287-fca6cb0afef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:40.344208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d14d-cdca-47f6-b287-fca6cb0afef9 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:40.344409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d14d-cdca-47f6-b287-fca6cb0afef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:40.344742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d14d-cdca-47f6-b287-fca6cb0afef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:40.356860 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d14d-cdca-47f6-b287-fca6cb0afef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:40.358398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d14d-cdca-47f6-b287-fca6cb0afef9 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:40.370185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1311/2619] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:40.462143 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0780b7a636407393bd966cb0bf2c2f', 'request_id': 'req-0d8677d4-7e05-459b-91c8-b574d937ea5c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.468798 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0780b7a636407393bd966cb0bf2c2f', 'request_id': 'req-0d8677d4-7e05-459b-91c8-b574d937ea5c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.546554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0780b7a636407393bd966cb0bf2c2f', 'request_id': 'req-0d8677d4-7e05-459b-91c8-b574d937ea5c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.559543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] The token cache is being invalidate because project 1c0780b7a636407393bd966cb0bf2c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:40.559833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.560562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.562635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1309/2620] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:40 2022] DELETE /identity/v3/projects/1c0780b7a636407393bd966cb0bf2c2f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:40.566786 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861d14d-cdca-47f6-b287-fca6cb0afef9 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:40.579138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861d14d-cdca-47f6-b287-fca6cb0afef9 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:40.588803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:40.590537 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:40.648035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:40.650875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:40.651732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:40.652086 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:40.652429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] PATH_INFO: `/v3/users/a2613dfb492043f9b5934ba33ac41899` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:40.654825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2613dfb492043f9b5934ba33ac41899)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:40.654994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8677d4-7e05-459b-91c8-b574d937ea5c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:40.656517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:40.660629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7829a-e6fe-42c6-abc8-5ab2f0ce05fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:40.661697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7829a-e6fe-42c6-abc8-5ab2f0ce05fa service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:40.662061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7829a-e6fe-42c6-abc8-5ab2f0ce05fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:40.662444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7829a-e6fe-42c6-abc8-5ab2f0ce05fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:40.665945 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-26a7829a-e6fe-42c6-abc8-5ab2f0ce05fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:40.743021 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7829a-e6fe-42c6-abc8-5ab2f0ce05fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:40.745020 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7829a-e6fe-42c6-abc8-5ab2f0ce05fa service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:40.759727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1310/2621] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:40.805315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbabb8-e3d5-4488-a023-0e7f7de0c652 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:40.805553 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbabb8-e3d5-4488-a023-0e7f7de0c652 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:40.806022 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbabb8-e3d5-4488-a023-0e7f7de0c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:40.835892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-7fcbabb8-e3d5-4488-a023-0e7f7de0c652 None None] MFA Rules not processed for user `ef4a60c04c3246b69921d251641bdef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:40.839318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7fcbabb8-e3d5-4488-a023-0e7f7de0c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:40.873820 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2613dfb492043f9b5934ba33ac41899'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.874706 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2613dfb492043f9b5934ba33ac41899'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.876065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2613dfb492043f9b5934ba33ac41899'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.919386 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2613dfb492043f9b5934ba33ac41899'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:40.932378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1311/2622] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:40.992275 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-4eabfb47-5707-427d-bd97-bb4aec275266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2613dfb492043f9b5934ba33ac41899'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:41.017488 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1312/2623] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:40 2022] DELETE /identity/v3/users/a2613dfb492043f9b5934ba33ac41899 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:41.792850 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbabb8-e3d5-4488-a023-0e7f7de0c652 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:41.794671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7fcbabb8-e3d5-4488-a023-0e7f7de0c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:41.816417 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbabb8-e3d5-4488-a023-0e7f7de0c652 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:41.928411 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:41.929096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:41.932246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:41.932246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] PATH_INFO: `/v3/projects/177fa3fa61a444579305ddb85202e1eb` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:41.932246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=177fa3fa61a444579305ddb85202e1eb)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:41.933797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:42.070360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177fa3fa61a444579305ddb85202e1eb', 'request_id': 'req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:42.072150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:42.078465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177fa3fa61a444579305ddb85202e1eb', 'request_id': 'req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:42.158253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177fa3fa61a444579305ddb85202e1eb', 'request_id': 'req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:42.171730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] The token cache is being invalidate because project 177fa3fa61a444579305ddb85202e1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:42.172025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:42.172695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-78ef4264-7a10-453a-ac21-0e1ca6c59e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:42.174597 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1312/2624] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:41 2022] DELETE /identity/v3/projects/177fa3fa61a444579305ddb85202e1eb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:42.180065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e95c1-0a3e-4d5d-97d8-969ae4a3041a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.180661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e95c1-0a3e-4d5d-97d8-969ae4a3041a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.180661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e95c1-0a3e-4d5d-97d8-969ae4a3041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:42.200974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-a99e95c1-0a3e-4d5d-97d8-969ae4a3041a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:42.202336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a99e95c1-0a3e-4d5d-97d8-969ae4a3041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:42.254902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:42.279432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1313/2625] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:42.288626 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc8c2-eaa0-4f16-9983-39c7bc1e8099 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.288958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc8c2-eaa0-4f16-9983-39c7bc1e8099 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.289307 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc8c2-eaa0-4f16-9983-39c7bc1e8099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:42.315800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-020dc8c2-eaa0-4f16-9983-39c7bc1e8099 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:42.317114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-020dc8c2-eaa0-4f16-9983-39c7bc1e8099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:42.326540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1313/2626] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:42.330945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e95c1-0a3e-4d5d-97d8-969ae4a3041a None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:42.341523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e95c1-0a3e-4d5d-97d8-969ae4a3041a None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:42.348030 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:42.348663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.348972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.349465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:42.349926 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:42.350224 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:42.352916 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:42.365451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1314/2627] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:42.369920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dc8c2-eaa0-4f16-9983-39c7bc1e8099 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:42.382009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dc8c2-eaa0-4f16-9983-39c7bc1e8099 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:42.385479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da31db-f38a-45b8-89b0-fb9d81924daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:42.386395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da31db-f38a-45b8-89b0-fb9d81924daa admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.386513 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da31db-f38a-45b8-89b0-fb9d81924daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.386829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da31db-f38a-45b8-89b0-fb9d81924daa admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:42.388024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da31db-f38a-45b8-89b0-fb9d81924daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:42.389609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da31db-f38a-45b8-89b0-fb9d81924daa admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:42.487008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1314/2628] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:42 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:42.491329 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:42.513176 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e7259-28f7-4f3a-8452-ecd6e482960e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:42.571662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c2fc9-9f85-4e0f-9fdb-e64be8bc40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:42.572287 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c2fc9-9f85-4e0f-9fdb-e64be8bc40ce admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.572560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c2fc9-9f85-4e0f-9fdb-e64be8bc40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.572828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c2fc9-9f85-4e0f-9fdb-e64be8bc40ce admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:42.573546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c2fc9-9f85-4e0f-9fdb-e64be8bc40ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:42.575508 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c2fc9-9f85-4e0f-9fdb-e64be8bc40ce admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:42.697569 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1315/2629] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:42 2022] POST /identity/v3/users => generated 282 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:42.707867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da31db-f38a-45b8-89b0-fb9d81924daa admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:42.731578 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da31db-f38a-45b8-89b0-fb9d81924daa admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:42.736682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c584f-3f52-4625-b654-b614d8b5ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:42.737348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c584f-3f52-4625-b654-b614d8b5ebb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.741495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c584f-3f52-4625-b654-b614d8b5ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.741495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c584f-3f52-4625-b654-b614d8b5ebb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:42.741495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c584f-3f52-4625-b654-b614d8b5ebb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:42.741495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c584f-3f52-4625-b654-b614d8b5ebb4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:42.761140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1315/2630] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:42.762281 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c2fc9-9f85-4e0f-9fdb-e64be8bc40ce admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:42.775984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c2fc9-9f85-4e0f-9fdb-e64be8bc40ce admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:42.785713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5c1a5-6a7e-4f3c-a4ee-0dd225ca03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:42.785923 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c1a5-6a7e-4f3c-a4ee-0dd225ca03ee admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.786199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c1a5-6a7e-4f3c-a4ee-0dd225ca03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.786473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c1a5-6a7e-4f3c-a4ee-0dd225ca03ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:42.787185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5c1a5-6a7e-4f3c-a4ee-0dd225ca03ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:42.788794 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5c1a5-6a7e-4f3c-a4ee-0dd225ca03ee admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:42.809714 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1316/2631] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:42.813840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c584f-3f52-4625-b654-b614d8b5ebb4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:42.825015 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c584f-3f52-4625-b654-b614d8b5ebb4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:42.830651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:42.830651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.830651 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.831099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] PATH_INFO: `/v3/projects/f4c9ecdc4cdb44278f7879df456d4313/users/e25d70309a7d427584c643b7f0e09f81/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:42.847094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c9ecdc4cdb44278f7879df456d4313, user_id=e25d70309a7d427584c643b7f0e09f81, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:42.850190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:42.971153 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1316/2632] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:42 2022] PUT /identity/v3/projects/f4c9ecdc4cdb44278f7879df456d4313/users/e25d70309a7d427584c643b7f0e09f81/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:42.984407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec824233-ae8b-4e5d-9a91-5a2157b266cd None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:42.985614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec824233-ae8b-4e5d-9a91-5a2157b266cd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:42.986482 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec824233-ae8b-4e5d-9a91-5a2157b266cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:43.038981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-ec824233-ae8b-4e5d-9a91-5a2157b266cd None None] MFA Rules not processed for user `e25d70309a7d427584c643b7f0e09f81`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:43.042298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ec824233-ae8b-4e5d-9a91-5a2157b266cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:43.191709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1317/2633] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:43.200145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:43.202558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:43.342397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd17b8c-2745-4a3d-bef2-a29173866040 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:43.346139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:43.346910 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:43.347574 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:43.347574 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:43.360676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:43.362624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:43.374264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1317/2634] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:43.724640 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec824233-ae8b-4e5d-9a91-5a2157b266cd None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:43.726102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ec824233-ae8b-4e5d-9a91-5a2157b266cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:43.776476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:43.805659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec824233-ae8b-4e5d-9a91-5a2157b266cd None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:43.811248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:43.811935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:43.812227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:43.812501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:43.814321 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:43.826784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:43.828396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:43.838816 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1318/2635] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:43.935611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:43.937706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:44.011858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a21ec-a551-441d-a147-56ef0f39371e service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:44.016593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:44.017273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:44.017558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:44.017834 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] PATH_INFO: `/v3/users/06323c8fcf99441f9f87db199e93c8b8` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:44.019106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06323c8fcf99441f9f87db199e93c8b8)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:44.021330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:44.043374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:44.185019 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06323c8fcf99441f9f87db199e93c8b8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:44.191984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06323c8fcf99441f9f87db199e93c8b8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:44.266636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06323c8fcf99441f9f87db199e93c8b8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:44.281991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06323c8fcf99441f9f87db199e93c8b8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:44.282781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a0cc4481-87b2-40a1-adab-ab5ed0d5a177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06323c8fcf99441f9f87db199e93c8b8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:44.288706 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1318/2636] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:43 2022] DELETE /identity/v3/users/06323c8fcf99441f9f87db199e93c8b8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:44.669427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:44.683917 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8e3e8-1eae-4029-9b7c-ff1528dd13a1 service placement] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:44.748966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:44.749606 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:44.749873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:44.750227 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] PATH_INFO: `/v3/projects/2c38062a586847d49d91c11739ee2418` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:44.751365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c38062a586847d49d91c11739ee2418)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:44.753387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:44.936951 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c38062a586847d49d91c11739ee2418', 'request_id': 'req-19e087b4-d67a-4906-8622-2b6881a14d30'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:44.942363 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c38062a586847d49d91c11739ee2418', 'request_id': 'req-19e087b4-d67a-4906-8622-2b6881a14d30'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:45.064950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c38062a586847d49d91c11739ee2418', 'request_id': 'req-19e087b4-d67a-4906-8622-2b6881a14d30'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:45.081322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] The token cache is being invalidate because project 2c38062a586847d49d91c11739ee2418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:45.081548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:45.082234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-19e087b4-d67a-4906-8622-2b6881a14d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:45.084006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1319/2637] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:44 2022] DELETE /identity/v3/projects/2c38062a586847d49d91c11739ee2418 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:45.089318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a1ec-80a2-49e2-85e2-5de7ab7c3f2c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.089801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a1ec-80a2-49e2-85e2-5de7ab7c3f2c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.089920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a1ec-80a2-49e2-85e2-5de7ab7c3f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.112312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9442a1ec-80a2-49e2-85e2-5de7ab7c3f2c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:45.113833 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9442a1ec-80a2-49e2-85e2-5de7ab7c3f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:45.189634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1319/2638] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:45.200981 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3be78-8fc5-44b0-b5fa-2f397972d389 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.201260 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3be78-8fc5-44b0-b5fa-2f397972d389 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.201594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3be78-8fc5-44b0-b5fa-2f397972d389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.226773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-97c3be78-8fc5-44b0-b5fa-2f397972d389 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:45.231006 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-97c3be78-8fc5-44b0-b5fa-2f397972d389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:45.258907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1320/2639] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:45.266064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442a1ec-80a2-49e2-85e2-5de7ab7c3f2c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:45.279076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442a1ec-80a2-49e2-85e2-5de7ab7c3f2c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:45.284638 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:45.285372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.285720 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.286061 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.286828 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:45.287202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:45.288981 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:45.303085 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1320/2640] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:45.308453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3be78-8fc5-44b0-b5fa-2f397972d389 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:45.318656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3be78-8fc5-44b0-b5fa-2f397972d389 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:45.325087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a124-c6ef-40fb-a422-f6155e4b1ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:45.326328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a124-c6ef-40fb-a422-f6155e4b1ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.326328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a124-c6ef-40fb-a422-f6155e4b1ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.329314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a124-c6ef-40fb-a422-f6155e4b1ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.329314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4a124-c6ef-40fb-a422-f6155e4b1ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:45.330501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4a124-c6ef-40fb-a422-f6155e4b1ea4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:45.472765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1321/2641] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:45 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:45.473939 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:45.484980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec3c9-75a2-4fa2-9dd4-d1746c682b6f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:45.554710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e07622-ede8-41e1-baaa-2c9c809935ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:45.555462 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e07622-ede8-41e1-baaa-2c9c809935ab admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.555815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e07622-ede8-41e1-baaa-2c9c809935ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.556152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e07622-ede8-41e1-baaa-2c9c809935ab admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.557024 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e07622-ede8-41e1-baaa-2c9c809935ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:45.559424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e07622-ede8-41e1-baaa-2c9c809935ab admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:45.668840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1321/2642] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:45 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:45.673496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a124-c6ef-40fb-a422-f6155e4b1ea4 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:45.685550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a124-c6ef-40fb-a422-f6155e4b1ea4 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:45.691080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3be0e-dc9d-47ed-aed2-9348753816ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:45.691798 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3be0e-dc9d-47ed-aed2-9348753816ba admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.692145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3be0e-dc9d-47ed-aed2-9348753816ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.692492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3be0e-dc9d-47ed-aed2-9348753816ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.693377 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3be0e-dc9d-47ed-aed2-9348753816ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:45.695046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3be0e-dc9d-47ed-aed2-9348753816ba admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:45.707165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1322/2643] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:45.711341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e07622-ede8-41e1-baaa-2c9c809935ab admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:45.725558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e07622-ede8-41e1-baaa-2c9c809935ab admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:45.736440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578a497-e303-4b4e-9597-2f8a4ffc4ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:45.737233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a497-e303-4b4e-9597-2f8a4ffc4ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.737595 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a497-e303-4b4e-9597-2f8a4ffc4ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.737950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a497-e303-4b4e-9597-2f8a4ffc4ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.738930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578a497-e303-4b4e-9597-2f8a4ffc4ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:45.742062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578a497-e303-4b4e-9597-2f8a4ffc4ba2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:45.759554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1322/2644] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:45.761203 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3be0e-dc9d-47ed-aed2-9348753816ba admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:45.778858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3be0e-dc9d-47ed-aed2-9348753816ba admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:45.786311 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79362-890c-4bd1-9843-ca2a5aa50b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:45.791104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79362-890c-4bd1-9843-ca2a5aa50b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.791104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79362-890c-4bd1-9843-ca2a5aa50b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.791104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79362-890c-4bd1-9843-ca2a5aa50b54 admin admin] PATH_INFO: `/v3/projects/d70edc9fa1ab4a29b4fb7cef359486e9/users/095d58be9c7c4f05921fa3a3ffdebe40/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.810548 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79362-890c-4bd1-9843-ca2a5aa50b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70edc9fa1ab4a29b4fb7cef359486e9, user_id=095d58be9c7c4f05921fa3a3ffdebe40, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:45.817152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79362-890c-4bd1-9843-ca2a5aa50b54 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:45.821005 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:45.895560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1323/2645] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:45 2022] PUT /identity/v3/projects/d70edc9fa1ab4a29b4fb7cef359486e9/users/095d58be9c7c4f05921fa3a3ffdebe40/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:45.906690 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5879d-0416-49b5-b298-068ab622aa9c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:45.906985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5879d-0416-49b5-b298-068ab622aa9c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:45.907267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5879d-0416-49b5-b298-068ab622aa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:45.915229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:45.950298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-f9b5879d-0416-49b5-b298-068ab622aa9c None None] MFA Rules not processed for user `095d58be9c7c4f05921fa3a3ffdebe40`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:45.951932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-f9b5879d-0416-49b5-b298-068ab622aa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:46.042956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1323/2646] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:46.047665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79362-890c-4bd1-9843-ca2a5aa50b54 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:46.124402 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79362-890c-4bd1-9843-ca2a5aa50b54 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:46.129466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98f9e-bd31-4661-aebb-c66fa95f5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:46.130166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98f9e-bd31-4661-aebb-c66fa95f5325 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:46.130666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98f9e-bd31-4661-aebb-c66fa95f5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:46.130859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98f9e-bd31-4661-aebb-c66fa95f5325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:46.131619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e98f9e-bd31-4661-aebb-c66fa95f5325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:46.134009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e98f9e-bd31-4661-aebb-c66fa95f5325 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:46.236704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1324/2647] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:46 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:46.238297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5879d-0416-49b5-b298-068ab622aa9c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:46.254941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5879d-0416-49b5-b298-068ab622aa9c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:46.333342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b2a6-52a0-4224-8368-a5e5d0beb761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:46.334278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b2a6-52a0-4224-8368-a5e5d0beb761 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:46.334567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b2a6-52a0-4224-8368-a5e5d0beb761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:46.334846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b2a6-52a0-4224-8368-a5e5d0beb761 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:46.335543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946b2a6-52a0-4224-8368-a5e5d0beb761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:46.338096 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946b2a6-52a0-4224-8368-a5e5d0beb761 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:46.432970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1324/2648] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:46 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:46.437480 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98f9e-bd31-4661-aebb-c66fa95f5325 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:46.453931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98f9e-bd31-4661-aebb-c66fa95f5325 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:46.459542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdfdd1-aea2-4353-9b37-4a5057527af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:46.459812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdfdd1-aea2-4353-9b37-4a5057527af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:46.459959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdfdd1-aea2-4353-9b37-4a5057527af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:46.460234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdfdd1-aea2-4353-9b37-4a5057527af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:46.460992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdfdd1-aea2-4353-9b37-4a5057527af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:46.462679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdfdd1-aea2-4353-9b37-4a5057527af0 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:46.474208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1325/2649] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:46.479259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b2a6-52a0-4224-8368-a5e5d0beb761 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:46.491431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b2a6-52a0-4224-8368-a5e5d0beb761 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:46.497233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59aded-7349-49b4-9bd6-01edeb5f6ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:46.497998 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59aded-7349-49b4-9bd6-01edeb5f6ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:46.498357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59aded-7349-49b4-9bd6-01edeb5f6ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:46.499293 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59aded-7349-49b4-9bd6-01edeb5f6ef5 admin admin] PATH_INFO: `/v3/projects/1a9776ce7d0d40b7b746f6552545720f/users/f2baa30d38c3440ca416f605e8336c07/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:46.515357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59aded-7349-49b4-9bd6-01edeb5f6ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9776ce7d0d40b7b746f6552545720f, user_id=f2baa30d38c3440ca416f605e8336c07, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:46.518374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59aded-7349-49b4-9bd6-01edeb5f6ef5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:46.626644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1325/2650] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:46 2022] PUT /identity/v3/projects/1a9776ce7d0d40b7b746f6552545720f/users/f2baa30d38c3440ca416f605e8336c07/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:46.630738 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdfdd1-aea2-4353-9b37-4a5057527af0 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:46.643165 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdfdd1-aea2-4353-9b37-4a5057527af0 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:46.706761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba715a3-25ef-4915-8942-a3ca37f854ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:46.708065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba715a3-25ef-4915-8942-a3ca37f854ff admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:46.708343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba715a3-25ef-4915-8942-a3ca37f854ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:46.708709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba715a3-25ef-4915-8942-a3ca37f854ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:46.713963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba715a3-25ef-4915-8942-a3ca37f854ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:46.716942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba715a3-25ef-4915-8942-a3ca37f854ff admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:46.731405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1326/2651] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:46.735837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59aded-7349-49b4-9bd6-01edeb5f6ef5 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:46.747495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59aded-7349-49b4-9bd6-01edeb5f6ef5 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:46.752727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:46.753495 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:46.756081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:46.756081 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] PATH_INFO: `/v3/projects/1a9776ce7d0d40b7b746f6552545720f/users/f2baa30d38c3440ca416f605e8336c07/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:46.756704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9776ce7d0d40b7b746f6552545720f, user_id=f2baa30d38c3440ca416f605e8336c07, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:46.759674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:46.771972 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1326/2652] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:46 2022] PUT /identity/v3/projects/1a9776ce7d0d40b7b746f6552545720f/users/f2baa30d38c3440ca416f605e8336c07/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:46.784460 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815301f7-6138-45ca-8d41-2a8b166d8540 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:46.784990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815301f7-6138-45ca-8d41-2a8b166d8540 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:46.785343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815301f7-6138-45ca-8d41-2a8b166d8540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:46.814543 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-815301f7-6138-45ca-8d41-2a8b166d8540 None None] MFA Rules not processed for user `f2baa30d38c3440ca416f605e8336c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:46.815783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-815301f7-6138-45ca-8d41-2a8b166d8540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:46.871961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:46.890667 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1327/2653] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:46.901958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:46.903789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:46.956445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:46.968764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14e867-f39f-41a3-a173-498d02bf65dd admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:46.972756 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:46.973501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:46.973790 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:46.974072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:46.985929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:46.987407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:46.999341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1327/2654] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:47.112656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815301f7-6138-45ca-8d41-2a8b166d8540 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:47.123614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815301f7-6138-45ca-8d41-2a8b166d8540 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:47.127843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777e589-17f6-4059-8f47-38c07bfefbaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:47.128280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777e589-17f6-4059-8f47-38c07bfefbaf service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:47.128573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777e589-17f6-4059-8f47-38c07bfefbaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:47.135745 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777e589-17f6-4059-8f47-38c07bfefbaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:47.192431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777e589-17f6-4059-8f47-38c07bfefbaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:47.193936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777e589-17f6-4059-8f47-38c07bfefbaf service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:47.204059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1328/2655] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:48.173356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:48.174797 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:48.241388 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616e649-ea21-4f20-9781-4f22c9ce4939 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:48.246961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:48.247634 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:48.247931 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:48.248187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] PATH_INFO: `/v3/users/e354803e951b45ec96589507e48328b3` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:48.249434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e354803e951b45ec96589507e48328b3)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:48.251305 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:48.439304 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e354803e951b45ec96589507e48328b3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:48.447145 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e354803e951b45ec96589507e48328b3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:48.533404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e354803e951b45ec96589507e48328b3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:48.547555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e354803e951b45ec96589507e48328b3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:48.548310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e354803e951b45ec96589507e48328b3'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:48.556660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1328/2656] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:48 2022] DELETE /identity/v3/users/e354803e951b45ec96589507e48328b3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:48.561385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946b968-5cde-46c4-b9ea-424f5d07271a None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:48.561881 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946b968-5cde-46c4-b9ea-424f5d07271a None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:48.561986 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946b968-5cde-46c4-b9ea-424f5d07271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:48.584366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b946b968-5cde-46c4-b9ea-424f5d07271a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:48.586040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b946b968-5cde-46c4-b9ea-424f5d07271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:48.665539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1329/2657] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:48.687930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:48.689446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:48.750916 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253773bf-0201-4965-a82c-77028903b01c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:48.754774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5757b-b9c3-4c64-957a-79831dd161b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:48.755335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5757b-b9c3-4c64-957a-79831dd161b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:48.755614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5757b-b9c3-4c64-957a-79831dd161b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:48.755888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5757b-b9c3-4c64-957a-79831dd161b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:48.765795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5757b-b9c3-4c64-957a-79831dd161b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:48.767545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5757b-b9c3-4c64-957a-79831dd161b6 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:48.778653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1329/2658] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:49.274509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946b968-5cde-46c4-b9ea-424f5d07271a None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:49.277724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b946b968-5cde-46c4-b9ea-424f5d07271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:49.289122 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946b968-5cde-46c4-b9ea-424f5d07271a None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:49.294107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:49.294767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:49.295078 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:49.302381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] PATH_INFO: `/v3/projects/f53d1f3c098849039d393c199dbbd7f3` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:49.303709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53d1f3c098849039d393c199dbbd7f3)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:49.305822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:49.420624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53d1f3c098849039d393c199dbbd7f3', 'request_id': 'req-b6a2e4cb-a377-4229-a1b6-514050d365f4'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.427151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53d1f3c098849039d393c199dbbd7f3', 'request_id': 'req-b6a2e4cb-a377-4229-a1b6-514050d365f4'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.521866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53d1f3c098849039d393c199dbbd7f3', 'request_id': 'req-b6a2e4cb-a377-4229-a1b6-514050d365f4'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.535066 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] The token cache is being invalidate because project f53d1f3c098849039d393c199dbbd7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:49.535352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.535988 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.537724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1330/2659] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:49 2022] DELETE /identity/v3/projects/f53d1f3c098849039d393c199dbbd7f3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:49.542187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5757b-b9c3-4c64-957a-79831dd161b6 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:49.552312 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5757b-b9c3-4c64-957a-79831dd161b6 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:49.558655 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:49.611826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:49.612478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:49.612765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:49.613071 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] PATH_INFO: `/v3/users/906f1ed890784e9e8babd945e82ba6f7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:49.614292 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=906f1ed890784e9e8babd945e82ba6f7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:49.616186 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:49.814946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '906f1ed890784e9e8babd945e82ba6f7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.823512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '906f1ed890784e9e8babd945e82ba6f7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.884322 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '906f1ed890784e9e8babd945e82ba6f7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.899408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '906f1ed890784e9e8babd945e82ba6f7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.900282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '906f1ed890784e9e8babd945e82ba6f7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:49.906372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1330/2660] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:49 2022] DELETE /identity/v3/users/906f1ed890784e9e8babd945e82ba6f7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:50.405840 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:50.407844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:50.418258 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:50.420038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:50.426131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2e4cb-a377-4229-a1b6-514050d365f4 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:50.438113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:50.509541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:50.510298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:50.510652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:50.510931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] PATH_INFO: `/v3/projects/538e70db3acb4b0296a690b25878e9ba` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:50.512148 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538e70db3acb4b0296a690b25878e9ba)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:50.514134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:50.530584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1bf2-5a4e-4465-ad17-29474d3a1983 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:50.536264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:50.537206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:50.537654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:50.538074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] PATH_INFO: `/v3/users/095d58be9c7c4f05921fa3a3ffdebe40` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:50.539637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095d58be9c7c4f05921fa3a3ffdebe40)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:50.542040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:50.656838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538e70db3acb4b0296a690b25878e9ba', 'request_id': 'req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.662492 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538e70db3acb4b0296a690b25878e9ba', 'request_id': 'req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.768979 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538e70db3acb4b0296a690b25878e9ba', 'request_id': 'req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.781828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] The token cache is being invalidate because project 538e70db3acb4b0296a690b25878e9ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:50.782114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.782753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-0e33d6d6-725c-4c3e-a9dc-a4078fea5016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.784336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1331/2661] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:50 2022] DELETE /identity/v3/projects/538e70db3acb4b0296a690b25878e9ba => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:50.789000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a31f5-60e0-46fe-9ee2-864700eeb2a6 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:50.789409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a31f5-60e0-46fe-9ee2-864700eeb2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:50.789697 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a31f5-60e0-46fe-9ee2-864700eeb2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:50.808792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-260a31f5-60e0-46fe-9ee2-864700eeb2a6 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:50.810017 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-260a31f5-60e0-46fe-9ee2-864700eeb2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:50.815691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:50.832167 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095d58be9c7c4f05921fa3a3ffdebe40'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.847696 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095d58be9c7c4f05921fa3a3ffdebe40'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.875156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1332/2662] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:50.884732 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a005d3-21e7-417a-9f79-aa2d6b04dd88 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:50.885052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a005d3-21e7-417a-9f79-aa2d6b04dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:50.885327 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a005d3-21e7-417a-9f79-aa2d6b04dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:50.905523 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f8a005d3-21e7-417a-9f79-aa2d6b04dd88 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:50.908452 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f8a005d3-21e7-417a-9f79-aa2d6b04dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:50.915290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1333/2663] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:50.919406 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a005d3-21e7-417a-9f79-aa2d6b04dd88 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:50.928396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a005d3-21e7-417a-9f79-aa2d6b04dd88 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:50.934040 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:50.934635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:50.934918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:50.935186 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:50.935868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:50.936171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:50.937797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:50.939114 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095d58be9c7c4f05921fa3a3ffdebe40'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.952233 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095d58be9c7c4f05921fa3a3ffdebe40'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.952963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-5e4b0ae0-077b-438b-8c8b-67d1de675965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095d58be9c7c4f05921fa3a3ffdebe40'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:50.959199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1334/2664] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:31:50.960198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:50.963397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:50.963657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1331/2665] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:50 2022] DELETE /identity/v3/users/095d58be9c7c4f05921fa3a3ffdebe40 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:50.967868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3cf4-f6b7-4a73-bee2-feddf1c2e14c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:50.968291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3cf4-f6b7-4a73-bee2-feddf1c2e14c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:50.968576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3cf4-f6b7-4a73-bee2-feddf1c2e14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:50.978966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c83a4-32bf-4c7c-834d-a607aa947362 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:50.987709 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-33dd3cf4-f6b7-4a73-bee2-feddf1c2e14c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:50.988965 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-33dd3cf4-f6b7-4a73-bee2-feddf1c2e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:51.001199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:51.046313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6db3f-7515-4a1c-8918-70b8de55ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:51.047038 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6db3f-7515-4a1c-8918-70b8de55ba14 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.047631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6db3f-7515-4a1c-8918-70b8de55ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.048001 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6db3f-7515-4a1c-8918-70b8de55ba14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.050211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6db3f-7515-4a1c-8918-70b8de55ba14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:51.052279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6db3f-7515-4a1c-8918-70b8de55ba14 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:51.067132 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1332/2666] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:51.073919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd3cf4-f6b7-4a73-bee2-feddf1c2e14c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:51.075392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-33dd3cf4-f6b7-4a73-bee2-feddf1c2e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:51.145389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd3cf4-f6b7-4a73-bee2-feddf1c2e14c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:51.149730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cda61b-ee1e-4571-ac78-ab416024e92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:51.150361 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cda61b-ee1e-4571-ac78-ab416024e92e service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.150637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cda61b-ee1e-4571-ac78-ab416024e92e service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.150902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cda61b-ee1e-4571-ac78-ab416024e92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.162767 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cda61b-ee1e-4571-ac78-ab416024e92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:51.164592 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cda61b-ee1e-4571-ac78-ab416024e92e service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:51.175614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1333/2667] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:51.178000 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1335/2668] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:50 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:51.182591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cda61b-ee1e-4571-ac78-ab416024e92e service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:51.193497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cda61b-ee1e-4571-ac78-ab416024e92e service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:51.248429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:51.259694 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f55d2-0a99-4350-ab85-29364e66ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:51.260321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f55d2-0a99-4350-ab85-29364e66ab5a admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.260603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f55d2-0a99-4350-ab85-29364e66ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.260877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f55d2-0a99-4350-ab85-29364e66ab5a admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.261582 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f55d2-0a99-4350-ab85-29364e66ab5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:51.263566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f55d2-0a99-4350-ab85-29364e66ab5a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:51.384843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1334/2669] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:51 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:51.389358 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6db3f-7515-4a1c-8918-70b8de55ba14 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:51.400668 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6db3f-7515-4a1c-8918-70b8de55ba14 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:51.405442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f8175-5ef4-484f-a7aa-36a578ec4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:51.406051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8175-5ef4-484f-a7aa-36a578ec4375 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.406641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8175-5ef4-484f-a7aa-36a578ec4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.406641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f8175-5ef4-484f-a7aa-36a578ec4375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.407290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f8175-5ef4-484f-a7aa-36a578ec4375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:51.408905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f8175-5ef4-484f-a7aa-36a578ec4375 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:51.421233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1336/2670] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:51.425206 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f55d2-0a99-4350-ab85-29364e66ab5a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:51.436791 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f55d2-0a99-4350-ab85-29364e66ab5a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:51.441918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c3b3-066f-4ef9-a512-54a632e09337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:51.442472 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c3b3-066f-4ef9-a512-54a632e09337 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.443125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c3b3-066f-4ef9-a512-54a632e09337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.443125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c3b3-066f-4ef9-a512-54a632e09337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.443707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c3b3-066f-4ef9-a512-54a632e09337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:51.445424 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c3b3-066f-4ef9-a512-54a632e09337 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:51.471970 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1335/2671] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:51.473503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f8175-5ef4-484f-a7aa-36a578ec4375 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:51.484399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f8175-5ef4-484f-a7aa-36a578ec4375 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:51.489882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:51.490629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.490972 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.491300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] PATH_INFO: `/v3/projects/e51773f35da245c28781a8a1a178bcc0/users/e41aecaae2954c4a8a16cacc0029b14d/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.509118 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51773f35da245c28781a8a1a178bcc0, user_id=e41aecaae2954c4a8a16cacc0029b14d, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:51.511812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:51.583083 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1337/2672] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:51 2022] PUT /identity/v3/projects/e51773f35da245c28781a8a1a178bcc0/users/e41aecaae2954c4a8a16cacc0029b14d/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:51.649383 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20474c-e837-4c5b-81c5-fe8549341ca8 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.649759 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20474c-e837-4c5b-81c5-fe8549341ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.650033 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20474c-e837-4c5b-81c5-fe8549341ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.678645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-7b20474c-e837-4c5b-81c5-fe8549341ca8 None None] MFA Rules not processed for user `e41aecaae2954c4a8a16cacc0029b14d`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:51.680518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7b20474c-e837-4c5b-81c5-fe8549341ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:51.735323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:51.739061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:51.753426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1336/2673] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:51.757238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20474c-e837-4c5b-81c5-fe8549341ca8 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:51.826110 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb7ec-5267-4612-b791-a8c6e261a82a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:51.831308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:51.831924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.832204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.832476 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] PATH_INFO: `/v3/projects/d70edc9fa1ab4a29b4fb7cef359486e9` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.833997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70edc9fa1ab4a29b4fb7cef359486e9)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:51.834140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20474c-e837-4c5b-81c5-fe8549341ca8 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:51.835581 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:51.840242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c7508-4479-4c43-9c6a-f25fab3b9464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:51.841156 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7508-4479-4c43-9c6a-f25fab3b9464 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:51.841468 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7508-4479-4c43-9c6a-f25fab3b9464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:51.841823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7508-4479-4c43-9c6a-f25fab3b9464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:51.844007 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c7508-4479-4c43-9c6a-f25fab3b9464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:51.846524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c7508-4479-4c43-9c6a-f25fab3b9464 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:51.950144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1337/2674] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:51 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:51.954433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c7508-4479-4c43-9c6a-f25fab3b9464 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:51.973221 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70edc9fa1ab4a29b4fb7cef359486e9', 'request_id': 'req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:51.981389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70edc9fa1ab4a29b4fb7cef359486e9', 'request_id': 'req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.032808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c7508-4479-4c43-9c6a-f25fab3b9464 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:52.066591 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70edc9fa1ab4a29b4fb7cef359486e9', 'request_id': 'req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.083756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] The token cache is being invalidate because project d70edc9fa1ab4a29b4fb7cef359486e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:52.084631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.085541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.093998 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1338/2675] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:51 2022] DELETE /identity/v3/projects/d70edc9fa1ab4a29b4fb7cef359486e9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:52.095603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:52.097276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:52.104532 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:52.105184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:52.105555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:52.105913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:52.106185 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:52.106920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:52.108874 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:52.180491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1338/2676] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:51 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:52.183087 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:52.190554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8aa7-4404-4be0-b1b6-6ee4c746c66c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:52.190779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:52.193297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:52.198032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:52.198684 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:52.198958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:52.199228 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] PATH_INFO: `/v3/users/f2baa30d38c3440ca416f605e8336c07` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:52.200664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2baa30d38c3440ca416f605e8336c07)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:52.202782 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:52.210345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d7d38-2c97-4a89-9bfe-135f708bb882 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:52.217604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e95e-f012-4ab3-a359-02c861d1db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:52.218370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e95e-f012-4ab3-a359-02c861d1db8c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:52.218795 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e95e-f012-4ab3-a359-02c861d1db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:52.219124 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e95e-f012-4ab3-a359-02c861d1db8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:52.220209 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2e95e-f012-4ab3-a359-02c861d1db8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:52.226520 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2e95e-f012-4ab3-a359-02c861d1db8c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:52.237279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1339/2677] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:52.246577 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e95e-f012-4ab3-a359-02c861d1db8c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:52.256514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e95e-f012-4ab3-a359-02c861d1db8c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:52.261699 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d9556-57e0-4aea-a36d-2e7ec92f357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:52.262310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9556-57e0-4aea-a36d-2e7ec92f357e admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:52.262591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9556-57e0-4aea-a36d-2e7ec92f357e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:52.262885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9556-57e0-4aea-a36d-2e7ec92f357e admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:52.263576 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d9556-57e0-4aea-a36d-2e7ec92f357e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:52.265254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d9556-57e0-4aea-a36d-2e7ec92f357e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:52.278668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1340/2678] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:52.286557 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d9556-57e0-4aea-a36d-2e7ec92f357e admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:52.297932 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d9556-57e0-4aea-a36d-2e7ec92f357e admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:52.303983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584bf17-8480-4b0e-b021-7fe880fbba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:52.304659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584bf17-8480-4b0e-b021-7fe880fbba2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:52.305535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584bf17-8480-4b0e-b021-7fe880fbba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:52.305823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584bf17-8480-4b0e-b021-7fe880fbba2a admin admin] PATH_INFO: `/v3/projects/f2b386383a2543c3a743e63051ef7166/users/3c4ac14b16ad4e94993bb2415f938960/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:52.326429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584bf17-8480-4b0e-b021-7fe880fbba2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b386383a2543c3a743e63051ef7166, user_id=3c4ac14b16ad4e94993bb2415f938960, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:52.329866 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584bf17-8480-4b0e-b021-7fe880fbba2a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:52.389121 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2baa30d38c3440ca416f605e8336c07'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.389795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2baa30d38c3440ca416f605e8336c07'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.390411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2baa30d38c3440ca416f605e8336c07'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.404637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2baa30d38c3440ca416f605e8336c07'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.431648 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1341/2679] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:52 2022] PUT /identity/v3/projects/f2b386383a2543c3a743e63051ef7166/users/3c4ac14b16ad4e94993bb2415f938960/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:52.441966 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fccd1d-cbbc-4c15-994e-a0e4f5d206ae None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:52.442187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fccd1d-cbbc-4c15-994e-a0e4f5d206ae None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:52.442458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fccd1d-cbbc-4c15-994e-a0e4f5d206ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:52.474892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-23fccd1d-cbbc-4c15-994e-a0e4f5d206ae None None] MFA Rules not processed for user `3c4ac14b16ad4e94993bb2415f938960`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:52.476136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-23fccd1d-cbbc-4c15-994e-a0e4f5d206ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:52.500716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2baa30d38c3440ca416f605e8336c07'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:52.517328 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1339/2680] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:52 2022] DELETE /identity/v3/users/f2baa30d38c3440ca416f605e8336c07 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:52.574496 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1342/2681] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:52.579294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:52.581099 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:52.665922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bf004-d076-4aa7-a2af-1db6d9b0d0c0 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:52.670683 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:52.671301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:52.671580 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:52.671854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:52.672526 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:52.674463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:52.779471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1340/2682] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:52 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:52.783415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fccd1d-cbbc-4c15-994e-a0e4f5d206ae None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:52.991315 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fccd1d-cbbc-4c15-994e-a0e4f5d206ae None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:52.995553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:52.997649 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:53.055941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893225cb-4900-4b34-aae7-727c01295bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.056591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893225cb-4900-4b34-aae7-727c01295bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.056868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893225cb-4900-4b34-aae7-727c01295bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.057172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893225cb-4900-4b34-aae7-727c01295bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.057840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893225cb-4900-4b34-aae7-727c01295bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.059741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893225cb-4900-4b34-aae7-727c01295bb3 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.074984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a425831-4cd5-450d-91e8-abb0aa8f850e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.080762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.081449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.081726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.082016 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] PATH_INFO: `/v3/projects/1a9776ce7d0d40b7b746f6552545720f` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.083237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9776ce7d0d40b7b746f6552545720f)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.085306 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.169984 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1343/2683] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:52 2022] POST /identity/v3/users => generated 299 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:53.174170 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893225cb-4900-4b34-aae7-727c01295bb3 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.184830 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893225cb-4900-4b34-aae7-727c01295bb3 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.189410 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346f796-f51d-4d2a-9408-72b2956d39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.190067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f796-f51d-4d2a-9408-72b2956d39a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.190437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f796-f51d-4d2a-9408-72b2956d39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.191801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f796-f51d-4d2a-9408-72b2956d39a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.192502 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346f796-f51d-4d2a-9408-72b2956d39a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.194158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346f796-f51d-4d2a-9408-72b2956d39a8 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.205896 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1344/2684] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:53.209860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346f796-f51d-4d2a-9408-72b2956d39a8 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.213701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9776ce7d0d40b7b746f6552545720f', 'request_id': 'req-7535b0b1-bcea-4a82-9902-a932614f595d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:53.219535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9776ce7d0d40b7b746f6552545720f', 'request_id': 'req-7535b0b1-bcea-4a82-9902-a932614f595d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:53.219721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346f796-f51d-4d2a-9408-72b2956d39a8 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.276346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.277127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.277407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.277686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] PATH_INFO: `/v3/projects/e9ee4ae7024549f9b810da746cb89410/users/81c6b0b9df314bc48ffa51c45c8f5250/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.289056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9776ce7d0d40b7b746f6552545720f', 'request_id': 'req-7535b0b1-bcea-4a82-9902-a932614f595d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:53.294162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ee4ae7024549f9b810da746cb89410, user_id=81c6b0b9df314bc48ffa51c45c8f5250, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.297017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.302551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] The token cache is being invalidate because project 1a9776ce7d0d40b7b746f6552545720f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:53.302950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:53.303620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-7535b0b1-bcea-4a82-9902-a932614f595d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:53.306259 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1341/2685] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:52 2022] DELETE /identity/v3/projects/1a9776ce7d0d40b7b746f6552545720f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:53.310924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1abd7-e92b-4648-88ba-431ae02ff1b4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.311229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1abd7-e92b-4648-88ba-431ae02ff1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.311497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1abd7-e92b-4648-88ba-431ae02ff1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.332393 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-9cd1abd7-e92b-4648-88ba-431ae02ff1b4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:53.334371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9cd1abd7-e92b-4648-88ba-431ae02ff1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:53.344100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1342/2686] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:53.352800 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46909c-126d-4219-9dd1-7af542e57213 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.353076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46909c-126d-4219-9dd1-7af542e57213 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.353353 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46909c-126d-4219-9dd1-7af542e57213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.373753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-3d46909c-126d-4219-9dd1-7af542e57213 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:53.375090 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3d46909c-126d-4219-9dd1-7af542e57213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:53.383338 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1343/2687] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:53.387427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46909c-126d-4219-9dd1-7af542e57213 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.396561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46909c-126d-4219-9dd1-7af542e57213 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.401826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.402413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.402689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.402958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.403632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:53.403934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.405549 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.418175 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1344/2688] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:31:53.423150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1345/2689] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:53 2022] PUT /identity/v3/projects/e9ee4ae7024549f9b810da746cb89410/users/81c6b0b9df314bc48ffa51c45c8f5250/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:53.423298 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.423867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.425544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:53.433425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1f773-5030-46ab-9211-e69ef4fbad1c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.447697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:53.493710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d138dd1-327d-421d-ad72-d1f97d5bd1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.494342 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d138dd1-327d-421d-ad72-d1f97d5bd1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.494619 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d138dd1-327d-421d-ad72-d1f97d5bd1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.494896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d138dd1-327d-421d-ad72-d1f97d5bd1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.495566 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d138dd1-327d-421d-ad72-d1f97d5bd1f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.502448 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d138dd1-327d-421d-ad72-d1f97d5bd1f0 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.512641 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd847-086b-4e71-968b-04fdcbcd110f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.517264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dabed-53f8-47ef-b312-480c09db8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.517876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dabed-53f8-47ef-b312-480c09db8293 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.518152 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dabed-53f8-47ef-b312-480c09db8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.518421 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dabed-53f8-47ef-b312-480c09db8293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.519117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dabed-53f8-47ef-b312-480c09db8293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.520977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dabed-53f8-47ef-b312-480c09db8293 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.532108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1346/2690] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:53.536235 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dabed-53f8-47ef-b312-480c09db8293 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.547526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dabed-53f8-47ef-b312-480c09db8293 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.555238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd4b98-a272-41ef-8d7e-413da0902ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.555238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4b98-a272-41ef-8d7e-413da0902ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.555238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4b98-a272-41ef-8d7e-413da0902ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.555238 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4b98-a272-41ef-8d7e-413da0902ecf admin admin] PATH_INFO: `/v3/projects/e9ee4ae7024549f9b810da746cb89410/users/81c6b0b9df314bc48ffa51c45c8f5250/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.556583 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd4b98-a272-41ef-8d7e-413da0902ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ee4ae7024549f9b810da746cb89410, user_id=81c6b0b9df314bc48ffa51c45c8f5250, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.559295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd4b98-a272-41ef-8d7e-413da0902ecf admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.570254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1347/2691] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:53 2022] PUT /identity/v3/projects/e9ee4ae7024549f9b810da746cb89410/users/81c6b0b9df314bc48ffa51c45c8f5250/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:31:53.581917 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e2b9-ae71-49de-9423-0ec41701b001 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.582208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e2b9-ae71-49de-9423-0ec41701b001 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.582488 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200e2b9-ae71-49de-9423-0ec41701b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.615229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1345/2692] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:53 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:53.616591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-8200e2b9-ae71-49de-9423-0ec41701b001 None None] MFA Rules not processed for user `81c6b0b9df314bc48ffa51c45c8f5250`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:53.617230 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d138dd1-327d-421d-ad72-d1f97d5bd1f0 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.618221 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8200e2b9-ae71-49de-9423-0ec41701b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:53.690806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d138dd1-327d-421d-ad72-d1f97d5bd1f0 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.697631 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50b630-70c4-4227-8e58-df2ed106351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.698496 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b630-70c4-4227-8e58-df2ed106351b admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.699120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b630-70c4-4227-8e58-df2ed106351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.699484 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b630-70c4-4227-8e58-df2ed106351b admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.700255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1348/2693] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:31:53.700405 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50b630-70c4-4227-8e58-df2ed106351b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.704499 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50b630-70c4-4227-8e58-df2ed106351b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.714765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200e2b9-ae71-49de-9423-0ec41701b001 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.716297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8200e2b9-ae71-49de-9423-0ec41701b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:53.786478 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200e2b9-ae71-49de-9423-0ec41701b001 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.790777 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.791394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.791670 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.791938 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.793836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:53.834788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1346/2694] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:53 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:53.839195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50b630-70c4-4227-8e58-df2ed106351b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.850072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50b630-70c4-4227-8e58-df2ed106351b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.855621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec49e98-aeda-42b1-8757-2212cc52d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.856257 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec49e98-aeda-42b1-8757-2212cc52d6ae admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.856497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.856621 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec49e98-aeda-42b1-8757-2212cc52d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.856788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec49e98-aeda-42b1-8757-2212cc52d6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.857551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec49e98-aeda-42b1-8757-2212cc52d6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.858092 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.869805 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec49e98-aeda-42b1-8757-2212cc52d6ae admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.870459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1349/2695] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:53.870560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1347/2696] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:53.874719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.886869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255214ea-7916-4546-8026-b5f8034e725a service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.893190 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474763-7493-45c6-9ca1-eb3746decac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.893808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474763-7493-45c6-9ca1-eb3746decac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.899433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474763-7493-45c6-9ca1-eb3746decac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.899433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474763-7493-45c6-9ca1-eb3746decac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.899433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474763-7493-45c6-9ca1-eb3746decac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.899433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474763-7493-45c6-9ca1-eb3746decac6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:53.907725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1350/2697] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:53.911673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec49e98-aeda-42b1-8757-2212cc52d6ae admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:53.924387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec49e98-aeda-42b1-8757-2212cc52d6ae admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:53.932688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b5677-8372-4a00-b6de-b11964ee767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:53.933408 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5677-8372-4a00-b6de-b11964ee767a admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:53.933737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5677-8372-4a00-b6de-b11964ee767a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:53.934163 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5677-8372-4a00-b6de-b11964ee767a admin admin] PATH_INFO: `/v3/projects/352f775d25a6487793bd4187a2931465/users/0e8bc27b71524aefb6637da414267c31/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:53.953715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b5677-8372-4a00-b6de-b11964ee767a admin admin] RBAC: Authorizing `identity:create_grant(project_id=352f775d25a6487793bd4187a2931465, user_id=0e8bc27b71524aefb6637da414267c31, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:53.956562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b5677-8372-4a00-b6de-b11964ee767a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:54.032702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1348/2698] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:53 2022] PUT /identity/v3/projects/352f775d25a6487793bd4187a2931465/users/0e8bc27b71524aefb6637da414267c31/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:54.044768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ae0a8-8cea-4bf8-9b25-9eda3c67d2c1 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:54.045323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ae0a8-8cea-4bf8-9b25-9eda3c67d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:54.045323 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ae0a8-8cea-4bf8-9b25-9eda3c67d2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:54.050812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:54.078155 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-9f2ae0a8-8cea-4bf8-9b25-9eda3c67d2c1 None None] MFA Rules not processed for user `0e8bc27b71524aefb6637da414267c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:54.079455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-9f2ae0a8-8cea-4bf8-9b25-9eda3c67d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:54.146629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1351/2699] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:54.157007 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b5677-8372-4a00-b6de-b11964ee767a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:54.221826 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b5677-8372-4a00-b6de-b11964ee767a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:54.227350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df1f7-a488-48a2-a85c-491c89e37307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:54.227985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df1f7-a488-48a2-a85c-491c89e37307 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:54.228253 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df1f7-a488-48a2-a85c-491c89e37307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:54.228660 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df1f7-a488-48a2-a85c-491c89e37307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:54.229355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df1f7-a488-48a2-a85c-491c89e37307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:54.231479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df1f7-a488-48a2-a85c-491c89e37307 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:54.416550 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1349/2700] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:54 2022] POST /identity/v3/projects => generated 379 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:54.420754 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ae0a8-8cea-4bf8-9b25-9eda3c67d2c1 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:54.431498 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ae0a8-8cea-4bf8-9b25-9eda3c67d2c1 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:54.488100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1c4f1-b00d-4265-bcca-b41abf52ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:54.488728 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c4f1-b00d-4265-bcca-b41abf52ed5f admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:54.489046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c4f1-b00d-4265-bcca-b41abf52ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:54.489321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c4f1-b00d-4265-bcca-b41abf52ed5f admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:54.490003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1c4f1-b00d-4265-bcca-b41abf52ed5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:54.491991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1c4f1-b00d-4265-bcca-b41abf52ed5f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:54.609439 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1352/2701] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:54 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:31:54.618084 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df1f7-a488-48a2-a85c-491c89e37307 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:54.625478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df1f7-a488-48a2-a85c-491c89e37307 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:54.630148 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc3ff-3e38-4f1f-bc6e-9120b80e867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:54.630753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc3ff-3e38-4f1f-bc6e-9120b80e867a admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:54.631025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc3ff-3e38-4f1f-bc6e-9120b80e867a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:54.631291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc3ff-3e38-4f1f-bc6e-9120b80e867a admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:54.631999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dc3ff-3e38-4f1f-bc6e-9120b80e867a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:54.633990 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dc3ff-3e38-4f1f-bc6e-9120b80e867a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:54.644698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1350/2702] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:54.655275 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1c4f1-b00d-4265-bcca-b41abf52ed5f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:54.666198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1c4f1-b00d-4265-bcca-b41abf52ed5f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:54.670810 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123390d-4a31-45bd-9996-7e343082cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:54.671458 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123390d-4a31-45bd-9996-7e343082cdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:54.671737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123390d-4a31-45bd-9996-7e343082cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:54.672011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123390d-4a31-45bd-9996-7e343082cdcb admin admin] PATH_INFO: `/v3/projects/d91fdad9445742fe91fbf02842ceae72/users/fb9f3c7d4f4e47ef932b9ce9cb49800d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:54.688808 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123390d-4a31-45bd-9996-7e343082cdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91fdad9445742fe91fbf02842ceae72, user_id=fb9f3c7d4f4e47ef932b9ce9cb49800d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:54.691705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123390d-4a31-45bd-9996-7e343082cdcb admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:54.769426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1353/2703] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:54 2022] PUT /identity/v3/projects/d91fdad9445742fe91fbf02842ceae72/users/fb9f3c7d4f4e47ef932b9ce9cb49800d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:54.773693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc3ff-3e38-4f1f-bc6e-9120b80e867a admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:54.784412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc3ff-3e38-4f1f-bc6e-9120b80e867a admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:54.850509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda79a4-ec57-4039-b4bc-6df60d699674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:54.851169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda79a4-ec57-4039-b4bc-6df60d699674 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:54.851479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda79a4-ec57-4039-b4bc-6df60d699674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:54.852411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda79a4-ec57-4039-b4bc-6df60d699674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:54.853146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda79a4-ec57-4039-b4bc-6df60d699674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:54.854742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda79a4-ec57-4039-b4bc-6df60d699674 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:54.866766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1351/2704] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:54.870523 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123390d-4a31-45bd-9996-7e343082cdcb admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:54.883259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123390d-4a31-45bd-9996-7e343082cdcb admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:54.888163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:54.888857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:54.889172 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:54.889465 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] PATH_INFO: `/v3/projects/d91fdad9445742fe91fbf02842ceae72/users/fb9f3c7d4f4e47ef932b9ce9cb49800d/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:54.891438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91fdad9445742fe91fbf02842ceae72, user_id=fb9f3c7d4f4e47ef932b9ce9cb49800d, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:54.894125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:54.905243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1354/2705] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:54 2022] PUT /identity/v3/projects/d91fdad9445742fe91fbf02842ceae72/users/fb9f3c7d4f4e47ef932b9ce9cb49800d/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:54.917366 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0f55-70fc-42fb-9ad8-9cdd73f27dfa None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:54.917656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0f55-70fc-42fb-9ad8-9cdd73f27dfa None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:54.917937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf0f55-70fc-42fb-9ad8-9cdd73f27dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:54.945401 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0fdf0f55-70fc-42fb-9ad8-9cdd73f27dfa None None] MFA Rules not processed for user `fb9f3c7d4f4e47ef932b9ce9cb49800d`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:54.946767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0fdf0f55-70fc-42fb-9ad8-9cdd73f27dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:55.020594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1352/2706] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:55.033862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:55.035530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:55.096346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c214fe-f7f6-4284-9e5e-53deb005495a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:55.099952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c22f0-bbf5-40d9-91d9-f1881a5fff65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:55.100579 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c22f0-bbf5-40d9-91d9-f1881a5fff65 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:55.100857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c22f0-bbf5-40d9-91d9-f1881a5fff65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:55.101223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c22f0-bbf5-40d9-91d9-f1881a5fff65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:55.110975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c22f0-bbf5-40d9-91d9-f1881a5fff65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:55.113112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c22f0-bbf5-40d9-91d9-f1881a5fff65 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:55.122163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1355/2707] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:55.123379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:55.733783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0f55-70fc-42fb-9ad8-9cdd73f27dfa None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:55.805473 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf0f55-70fc-42fb-9ad8-9cdd73f27dfa None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:55.810094 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:55.810744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:55.811029 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:55.811409 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] PATH_INFO: `/v3/users/0e8bc27b71524aefb6637da414267c31` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:55.812658 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8bc27b71524aefb6637da414267c31)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:55.814823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:56.015231 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8bc27b71524aefb6637da414267c31'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:56.015912 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8bc27b71524aefb6637da414267c31'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:56.016592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8bc27b71524aefb6637da414267c31'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:56.031762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8bc27b71524aefb6637da414267c31'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:56.091354 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c22f0-bbf5-40d9-91d9-f1881a5fff65 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:56.093868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fb4568f6-d614-4a88-84a7-026f95e071c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8bc27b71524aefb6637da414267c31'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:56.112412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1353/2708] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:55 2022] DELETE /identity/v3/users/0e8bc27b71524aefb6637da414267c31 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:56.117546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643b21-2da1-49c4-bb6d-099fb582ffc3 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:56.118848 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643b21-2da1-49c4-bb6d-099fb582ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:56.119507 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643b21-2da1-49c4-bb6d-099fb582ffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:56.121779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c22f0-bbf5-40d9-91d9-f1881a5fff65 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:56.145158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b7643b21-2da1-49c4-bb6d-099fb582ffc3 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:56.146663 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b7643b21-2da1-49c4-bb6d-099fb582ffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:56.232611 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:56.233087 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1354/2709] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:56.233372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:56.233776 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:56.234060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:56.237341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:56.247128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7643b21-2da1-49c4-bb6d-099fb582ffc3 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:56.251937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b7643b21-2da1-49c4-bb6d-099fb582ffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:56.331427 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:56.333445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:56.345015 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7643b21-2da1-49c4-bb6d-099fb582ffc3 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:56.346526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1356/2710] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:56.353950 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98cd31-9812-4e34-9e6a-5b7133d48946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:56.355035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98cd31-9812-4e34-9e6a-5b7133d48946 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:56.355509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98cd31-9812-4e34-9e6a-5b7133d48946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:56.355991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98cd31-9812-4e34-9e6a-5b7133d48946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:56.370498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98cd31-9812-4e34-9e6a-5b7133d48946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:56.372042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98cd31-9812-4e34-9e6a-5b7133d48946 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:56.382592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1355/2711] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:56.856133 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:56.857641 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:56.883924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace00ac0-8a46-433d-b30d-b2a6d34720db service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:56.889338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:56.889985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:56.890261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:56.890530 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] PATH_INFO: `/v3/projects/352f775d25a6487793bd4187a2931465` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:56.891794 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=352f775d25a6487793bd4187a2931465)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:56.893905 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:56.923984 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:57.050313 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:57.069951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352f775d25a6487793bd4187a2931465', 'request_id': 'req-b9f52a56-7462-4971-b5db-ad11042176fa'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.076680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352f775d25a6487793bd4187a2931465', 'request_id': 'req-b9f52a56-7462-4971-b5db-ad11042176fa'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.145379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352f775d25a6487793bd4187a2931465', 'request_id': 'req-b9f52a56-7462-4971-b5db-ad11042176fa'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.159035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] The token cache is being invalidate because project 352f775d25a6487793bd4187a2931465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:57.159314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.159996 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-b9f52a56-7462-4971-b5db-ad11042176fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.161540 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1357/2712] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:56 2022] DELETE /identity/v3/projects/352f775d25a6487793bd4187a2931465 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:57.166144 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98cd31-9812-4e34-9e6a-5b7133d48946 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:57.176438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98cd31-9812-4e34-9e6a-5b7133d48946 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:57.236583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:57.237290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:57.237571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:57.237845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] PATH_INFO: `/v3/users/fb9f3c7d4f4e47ef932b9ce9cb49800d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:57.238997 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9f3c7d4f4e47ef932b9ce9cb49800d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:57.240956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:57.425761 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9f3c7d4f4e47ef932b9ce9cb49800d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.426431 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9f3c7d4f4e47ef932b9ce9cb49800d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.427184 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9f3c7d4f4e47ef932b9ce9cb49800d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.444940 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9f3c7d4f4e47ef932b9ce9cb49800d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.514382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9f3c7d4f4e47ef932b9ce9cb49800d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:57.527688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1356/2713] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:57 2022] DELETE /identity/v3/users/fb9f3c7d4f4e47ef932b9ce9cb49800d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:57.815616 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:57.942247 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdee13-62f4-42f8-97f4-7857685a7abc None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:57.942535 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdee13-62f4-42f8-97f4-7857685a7abc None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:57.942812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdee13-62f4-42f8-97f4-7857685a7abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:57.965097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-40bdee13-62f4-42f8-97f4-7857685a7abc None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:57.965097 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-40bdee13-62f4-42f8-97f4-7857685a7abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:57.973475 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:57.974901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:58.030229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1358/2714] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:58.031099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdee13-62f4-42f8-97f4-7857685a7abc None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:58.032407 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-40bdee13-62f4-42f8-97f4-7857685a7abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:58.044301 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87dbce-59a4-4b05-afc7-669c2b654dd0 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:58.046755 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:58.050612 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:58.050727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.050963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.051207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.053441 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:58.109622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdee13-62f4-42f8-97f4-7857685a7abc None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:58.114205 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:58.114847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.115130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.115405 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] PATH_INFO: `/v3/projects/d91fdad9445742fe91fbf02842ceae72` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.116632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91fdad9445742fe91fbf02842ceae72)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:58.118908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:58.128603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:58.130081 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:58.140292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1357/2715] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:31:58.225375 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:58.225956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:58.273803 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91fdad9445742fe91fbf02842ceae72', 'request_id': 'req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:58.280505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91fdad9445742fe91fbf02842ceae72', 'request_id': 'req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:58.299478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784dcc-cceb-4f82-a284-3d0c4843ee80 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:58.358049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91fdad9445742fe91fbf02842ceae72', 'request_id': 'req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:58.363177 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e896d1-7fa7-4d21-aaed-d3047becf292 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:58.363897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e896d1-7fa7-4d21-aaed-d3047becf292 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.367882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e896d1-7fa7-4d21-aaed-d3047becf292 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.367882 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e896d1-7fa7-4d21-aaed-d3047becf292 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.373451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] The token cache is being invalidate because project d91fdad9445742fe91fbf02842ceae72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:31:58.373753 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:58.374479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-eefb1dc7-08b5-4d26-b966-45ad0eaadbb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:58.376653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1359/2716] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:31:58 2022] DELETE /identity/v3/projects/d91fdad9445742fe91fbf02842ceae72 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:58.381691 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f18bb-8e73-4db4-bcb3-f7e511aa1b0f None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.382046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f18bb-8e73-4db4-bcb3-f7e511aa1b0f None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.382392 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f18bb-8e73-4db4-bcb3-f7e511aa1b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.405117 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-de1f18bb-8e73-4db4-bcb3-f7e511aa1b0f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:58.406367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-de1f18bb-8e73-4db4-bcb3-f7e511aa1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:58.427694 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e896d1-7fa7-4d21-aaed-d3047becf292 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:58.429240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e896d1-7fa7-4d21-aaed-d3047becf292 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:58.438982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1358/2717] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:31:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:31:58.467893 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1360/2718] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:58.476478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecf45-06d5-476b-a746-dfcd6157a90c None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.476838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecf45-06d5-476b-a746-dfcd6157a90c None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.477185 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecf45-06d5-476b-a746-dfcd6157a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.483735 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:58.500427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-395ecf45-06d5-476b-a746-dfcd6157a90c None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:58.501838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-395ecf45-06d5-476b-a746-dfcd6157a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:58.510267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1359/2719] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:58.514770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f18bb-8e73-4db4-bcb3-f7e511aa1b0f None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:58.525282 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f18bb-8e73-4db4-bcb3-f7e511aa1b0f None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:58.530066 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:58.530676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.530956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.531255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.531951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:31:58.532278 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:58.533902 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:58.546441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1361/2720] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:31:58.550787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ecf45-06d5-476b-a746-dfcd6157a90c None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:58.560587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ecf45-06d5-476b-a746-dfcd6157a90c None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:58.565320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d65d2-f516-4b21-9d45-edf3bea7f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:58.566396 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d65d2-f516-4b21-9d45-edf3bea7f8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.570888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d65d2-f516-4b21-9d45-edf3bea7f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.570888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d65d2-f516-4b21-9d45-edf3bea7f8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.570888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d65d2-f516-4b21-9d45-edf3bea7f8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:58.570888 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d65d2-f516-4b21-9d45-edf3bea7f8c8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:58.695768 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:58.703025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1360/2721] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:31:58 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:58.707075 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:58.720327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f167-ff63-422f-b7ff-5e142a677d90 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:58.782775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ddf9-f1e7-4c58-911a-e19e55beb9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:58.783486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ddf9-f1e7-4c58-911a-e19e55beb9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.783765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ddf9-f1e7-4c58-911a-e19e55beb9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.784064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ddf9-f1e7-4c58-911a-e19e55beb9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.784736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478ddf9-f1e7-4c58-911a-e19e55beb9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:58.786901 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478ddf9-f1e7-4c58-911a-e19e55beb9f4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:58.913294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1362/2722] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:31:58 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:31:58.918343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d65d2-f516-4b21-9d45-edf3bea7f8c8 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:58.928670 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d65d2-f516-4b21-9d45-edf3bea7f8c8 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:58.935982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421ad9e-17b6-4443-a866-0b5f37707559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:58.935982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421ad9e-17b6-4443-a866-0b5f37707559 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.935982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421ad9e-17b6-4443-a866-0b5f37707559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.935982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421ad9e-17b6-4443-a866-0b5f37707559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.936445 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421ad9e-17b6-4443-a866-0b5f37707559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:58.937531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421ad9e-17b6-4443-a866-0b5f37707559 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:58.948977 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1361/2723] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:31:58.953288 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ddf9-f1e7-4c58-911a-e19e55beb9f4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:58.964069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ddf9-f1e7-4c58-911a-e19e55beb9f4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:58.968820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d2bab-b2a3-4a43-abf5-d2f262f6a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:58.969453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d2bab-b2a3-4a43-abf5-d2f262f6a04c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:58.969737 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d2bab-b2a3-4a43-abf5-d2f262f6a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:58.970011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d2bab-b2a3-4a43-abf5-d2f262f6a04c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:58.970702 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d2bab-b2a3-4a43-abf5-d2f262f6a04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:58.972337 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d2bab-b2a3-4a43-abf5-d2f262f6a04c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:58.987168 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1363/2724] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:31:58.988471 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421ad9e-17b6-4443-a866-0b5f37707559 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:58.999381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421ad9e-17b6-4443-a866-0b5f37707559 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:59.007608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:59.007608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:59.007608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:59.007608 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] PATH_INFO: `/v3/projects/c840a537cf2a4292b220ca2069c51b4b/users/00a540cb8d8f4f768b5ff2cab8ee4f6f/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:59.030152 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c840a537cf2a4292b220ca2069c51b4b, user_id=00a540cb8d8f4f768b5ff2cab8ee4f6f, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:59.032912 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:59.133082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1362/2725] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:31:58 2022] PUT /identity/v3/projects/c840a537cf2a4292b220ca2069c51b4b/users/00a540cb8d8f4f768b5ff2cab8ee4f6f/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:59.141115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa27683-6382-4ffb-969c-166f1adc6e27 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:59.141404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa27683-6382-4ffb-969c-166f1adc6e27 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:59.141677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa27683-6382-4ffb-969c-166f1adc6e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:59.172164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ffa27683-6382-4ffb-969c-166f1adc6e27 None None] MFA Rules not processed for user `00a540cb8d8f4f768b5ff2cab8ee4f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:59.173617 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ffa27683-6382-4ffb-969c-166f1adc6e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:59.202629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:59.231664 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:59.240961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1364/2726] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:59.263425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:59.268807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:59.326236 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d103d-1b9c-41c1-ad1b-2a7dc2ee6d67 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:59.329824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0b44-01fa-47ec-93a3-ba07d88c28c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:59.330538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0b44-01fa-47ec-93a3-ba07d88c28c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:59.330753 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0b44-01fa-47ec-93a3-ba07d88c28c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:59.331070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0b44-01fa-47ec-93a3-ba07d88c28c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:59.339949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0b44-01fa-47ec-93a3-ba07d88c28c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:59.341397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0b44-01fa-47ec-93a3-ba07d88c28c5 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:59.350630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1363/2727] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:31:59.370177 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa27683-6382-4ffb-969c-166f1adc6e27 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:59.439730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa27683-6382-4ffb-969c-166f1adc6e27 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:59.443647 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f102-a8e2-48c8-98ef-2e18a7d1fb79 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:59.444249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f102-a8e2-48c8-98ef-2e18a7d1fb79 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:59.444673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f102-a8e2-48c8-98ef-2e18a7d1fb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:59.445327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:59.446028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:59.447069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:59.447336 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] PATH_INFO: `/v3/users/00a540cb8d8f4f768b5ff2cab8ee4f6f` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:59.448717 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a540cb8d8f4f768b5ff2cab8ee4f6f)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:59.450809 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:59.484878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-fc47f102-a8e2-48c8-98ef-2e18a7d1fb79 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:59.486176 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fc47f102-a8e2-48c8-98ef-2e18a7d1fb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:59.552941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1364/2728] 10.222.0.93 () {58 vars in 967 bytes} [Thu Aug 4 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:59.567223 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f102-a8e2-48c8-98ef-2e18a7d1fb79 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:59.568828 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fc47f102-a8e2-48c8-98ef-2e18a7d1fb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:59.644579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f102-a8e2-48c8-98ef-2e18a7d1fb79 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:59.650877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757a18e-8bd8-4036-bd22-3e3c470fb31f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:59.651501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757a18e-8bd8-4036-bd22-3e3c470fb31f service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:59.651813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757a18e-8bd8-4036-bd22-3e3c470fb31f service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:59.652085 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757a18e-8bd8-4036-bd22-3e3c470fb31f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:59.660490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757a18e-8bd8-4036-bd22-3e3c470fb31f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:59.662142 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757a18e-8bd8-4036-bd22-3e3c470fb31f service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:31:59.670837 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a540cb8d8f4f768b5ff2cab8ee4f6f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:59.671248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1365/2729] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:31:59.678183 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a540cb8d8f4f768b5ff2cab8ee4f6f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:59.790573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a540cb8d8f4f768b5ff2cab8ee4f6f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:59.803404 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a540cb8d8f4f768b5ff2cab8ee4f6f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:59.804213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a540cb8d8f4f768b5ff2cab8ee4f6f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:31:59.810441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1365/2730] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:31:59 2022] DELETE /identity/v3/users/00a540cb8d8f4f768b5ff2cab8ee4f6f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:31:59.815035 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910459b1-dd72-4334-b14a-c482ad414d50 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:59.815707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910459b1-dd72-4334-b14a-c482ad414d50 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:59.815707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910459b1-dd72-4334-b14a-c482ad414d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:59.834949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-910459b1-dd72-4334-b14a-c482ad414d50 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:31:59.836138 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-910459b1-dd72-4334-b14a-c482ad414d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:59.898427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1366/2731] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:31:59.909098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:31:59.910567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:31:59.927785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:59.969994 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:31:59.981605 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae723bea-b3c7-4a67-9eb1-c5d3ed2a0f2e admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:31:59.985222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:31:59.985842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:31:59.986125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:31:59.987505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:31:59.995942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:31:59.997367 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:00.007831 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1366/2732] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:00.430028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad1cc-79c0-4a9a-9827-7a355c91e6af None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:00.431242 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad1cc-79c0-4a9a-9827-7a355c91e6af None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:00.431469 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad1cc-79c0-4a9a-9827-7a355c91e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:00.451479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-0bcad1cc-79c0-4a9a-9827-7a355c91e6af None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:00.452713 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0bcad1cc-79c0-4a9a-9827-7a355c91e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:00.503789 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:00.505234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:00.530573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1367/2733] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:32:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:00.535098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2742f6-e1bb-4b0d-9d3f-aa31981ae433 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:00.542544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:00.543487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:00.543950 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:00.545584 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcad1cc-79c0-4a9a-9827-7a355c91e6af None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:00.550999 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-0bcad1cc-79c0-4a9a-9827-7a355c91e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:00.557373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] PATH_INFO: `/v3/projects/c840a537cf2a4292b220ca2069c51b4b` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:00.558843 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c840a537cf2a4292b220ca2069c51b4b)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:00.561198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:00.639783 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcad1cc-79c0-4a9a-9827-7a355c91e6af None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:00.645046 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cc71d-9b48-4114-8e60-a661a77645c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:00.645933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc71d-9b48-4114-8e60-a661a77645c1 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:00.646211 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc71d-9b48-4114-8e60-a661a77645c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:00.646490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc71d-9b48-4114-8e60-a661a77645c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:00.656904 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cc71d-9b48-4114-8e60-a661a77645c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:00.658542 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cc71d-9b48-4114-8e60-a661a77645c1 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:00.667404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1368/2734] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:32:00.677255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c840a537cf2a4292b220ca2069c51b4b', 'request_id': 'req-a732ec32-4286-46d9-a543-3d4ae9a65f70'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:00.677255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:00.678637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c840a537cf2a4292b220ca2069c51b4b', 'request_id': 'req-a732ec32-4286-46d9-a543-3d4ae9a65f70'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:00.763267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c840a537cf2a4292b220ca2069c51b4b', 'request_id': 'req-a732ec32-4286-46d9-a543-3d4ae9a65f70'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:00.763678 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:00.775870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] The token cache is being invalidate because project c840a537cf2a4292b220ca2069c51b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:00.776162 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:00.776818 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-a732ec32-4286-46d9-a543-3d4ae9a65f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:00.778373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1367/2735] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:00 2022] DELETE /identity/v3/projects/c840a537cf2a4292b220ca2069c51b4b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:00.784703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a87844-a91e-4e5f-ad81-15e713e7f78f None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:00.785025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a87844-a91e-4e5f-ad81-15e713e7f78f None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:00.785299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a87844-a91e-4e5f-ad81-15e713e7f78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:00.806792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c8a87844-a91e-4e5f-ad81-15e713e7f78f None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:00.807364 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c8a87844-a91e-4e5f-ad81-15e713e7f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:00.867538 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1369/2736] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:00.876528 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279ce4-b3f3-45ca-9862-0141116a3c7a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:00.876925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279ce4-b3f3-45ca-9862-0141116a3c7a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:00.877396 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279ce4-b3f3-45ca-9862-0141116a3c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:00.897740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-b8279ce4-b3f3-45ca-9862-0141116a3c7a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:00.898952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-b8279ce4-b3f3-45ca-9862-0141116a3c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:00.907446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1368/2737] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:00.915151 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a87844-a91e-4e5f-ad81-15e713e7f78f None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:00.921383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a87844-a91e-4e5f-ad81-15e713e7f78f None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:00.926170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:00.926771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:00.927048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:00.927315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:00.927991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:32:00.928289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:00.929908 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:00.942438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1370/2738] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:32:00.947707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279ce4-b3f3-45ca-9862-0141116a3c7a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:00.956801 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279ce4-b3f3-45ca-9862-0141116a3c7a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:00.961968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f246-1022-4d68-92b4-8d7cc3097a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:00.962859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f246-1022-4d68-92b4-8d7cc3097a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:00.962955 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f246-1022-4d68-92b4-8d7cc3097a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:00.963157 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f246-1022-4d68-92b4-8d7cc3097a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:00.963836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f246-1022-4d68-92b4-8d7cc3097a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:00.965888 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f246-1022-4d68-92b4-8d7cc3097a52 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:01.063178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1369/2739] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:32:00 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:01.064585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:01.076958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b38dd3-994a-48c8-a696-4789674769e5 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:01.159028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b9d2-de40-4d53-90db-6cbac9512d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:01.159661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b9d2-de40-4d53-90db-6cbac9512d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:01.159942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b9d2-de40-4d53-90db-6cbac9512d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:01.160213 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b9d2-de40-4d53-90db-6cbac9512d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:01.160922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49b9d2-de40-4d53-90db-6cbac9512d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:01.162872 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49b9d2-de40-4d53-90db-6cbac9512d38 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:01.255322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1371/2740] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:32:01 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:01.260259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f246-1022-4d68-92b4-8d7cc3097a52 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:01.273600 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f246-1022-4d68-92b4-8d7cc3097a52 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:01.281745 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579ff01-4557-4b99-85dc-9f68f4939441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:01.282758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ff01-4557-4b99-85dc-9f68f4939441 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:01.283217 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ff01-4557-4b99-85dc-9f68f4939441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:01.283668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ff01-4557-4b99-85dc-9f68f4939441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:01.285018 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579ff01-4557-4b99-85dc-9f68f4939441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:01.287781 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579ff01-4557-4b99-85dc-9f68f4939441 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:01.308028 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1370/2741] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:01.312059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b9d2-de40-4d53-90db-6cbac9512d38 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:01.326503 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b9d2-de40-4d53-90db-6cbac9512d38 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:01.331727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad0ba-97a9-442c-844f-32b3d25aa769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:01.332398 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad0ba-97a9-442c-844f-32b3d25aa769 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:01.332687 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad0ba-97a9-442c-844f-32b3d25aa769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:01.332978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad0ba-97a9-442c-844f-32b3d25aa769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:01.333919 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad0ba-97a9-442c-844f-32b3d25aa769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:01.335577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad0ba-97a9-442c-844f-32b3d25aa769 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:01.346975 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686615aa-6b99-4f56-8e06-af672b0ef23d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:01.347280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686615aa-6b99-4f56-8e06-af672b0ef23d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:01.350112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686615aa-6b99-4f56-8e06-af672b0ef23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:01.365028 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1372/2742] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:32:01.365976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad0ba-97a9-442c-844f-32b3d25aa769 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:01.371356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-686615aa-6b99-4f56-8e06-af672b0ef23d None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:01.372625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-686615aa-6b99-4f56-8e06-af672b0ef23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:01.376776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad0ba-97a9-442c-844f-32b3d25aa769 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:01.382994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e0ce4-5223-4a60-a0ae-fa83f53bf6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:01.384216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0ce4-5223-4a60-a0ae-fa83f53bf6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:01.385367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0ce4-5223-4a60-a0ae-fa83f53bf6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:01.385822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0ce4-5223-4a60-a0ae-fa83f53bf6fc admin admin] PATH_INFO: `/v3/projects/67607f5aaea940ae81eed5095eedd2c0/users/0c9304ddb8f9479da987738b65e0f87c/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:01.407220 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:01.413876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e0ce4-5223-4a60-a0ae-fa83f53bf6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=67607f5aaea940ae81eed5095eedd2c0, user_id=0c9304ddb8f9479da987738b65e0f87c, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:01.419133 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e0ce4-5223-4a60-a0ae-fa83f53bf6fc admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:01.462695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1371/2743] 10.222.0.93 () {58 vars in 967 bytes} [Thu Aug 4 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:01.474969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686615aa-6b99-4f56-8e06-af672b0ef23d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:01.476408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-686615aa-6b99-4f56-8e06-af672b0ef23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:01.529137 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1373/2744] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:01 2022] PUT /identity/v3/projects/67607f5aaea940ae81eed5095eedd2c0/users/0c9304ddb8f9479da987738b65e0f87c/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:01.532876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14931cf6-b87d-4fbf-807f-9100df894949 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:01.533199 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14931cf6-b87d-4fbf-807f-9100df894949 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:01.533571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14931cf6-b87d-4fbf-807f-9100df894949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:01.556036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686615aa-6b99-4f56-8e06-af672b0ef23d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:01.573852 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-14931cf6-b87d-4fbf-807f-9100df894949 None None] MFA Rules not processed for user `0c9304ddb8f9479da987738b65e0f87c`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:01.575115 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-14931cf6-b87d-4fbf-807f-9100df894949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:01.638530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:01.738345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:01.760332 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:01.761428 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:01.761961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:01.762295 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:01.773102 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1374/2745] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:01.838661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:01.840187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:01.849409 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1372/2746] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:32:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:32:02.234976 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14931cf6-b87d-4fbf-807f-9100df894949 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:02.236436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-14931cf6-b87d-4fbf-807f-9100df894949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:02.307530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14931cf6-b87d-4fbf-807f-9100df894949 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:02.311113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804b5d-ecf8-4072-8c4b-c898f4af821b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad56212b530461cb19f1bb2b4b14027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:02.311836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804b5d-ecf8-4072-8c4b-c898f4af821b service glance] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:02.312124 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804b5d-ecf8-4072-8c4b-c898f4af821b service glance] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:02.312399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804b5d-ecf8-4072-8c4b-c898f4af821b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:02.322554 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87804b5d-ecf8-4072-8c4b-c898f4af821b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:02.323987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87804b5d-ecf8-4072-8c4b-c898f4af821b service glance] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:02.334289 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1375/2747] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:03.191013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:03.192454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:03.278935 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ae4b7-3856-48de-82b4-c022c76abc08 service swift] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:03.299393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:03.299393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:03.299393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:03.299393 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] PATH_INFO: `/v3/users/e41aecaae2954c4a8a16cacc0029b14d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:03.299892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41aecaae2954c4a8a16cacc0029b14d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:03.299892 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:03.635079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41aecaae2954c4a8a16cacc0029b14d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:03.642154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41aecaae2954c4a8a16cacc0029b14d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:03.729879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41aecaae2954c4a8a16cacc0029b14d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:03.744825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41aecaae2954c4a8a16cacc0029b14d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:03.745602 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41aecaae2954c4a8a16cacc0029b14d'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:03.753389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1373/2748] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:03 2022] DELETE /identity/v3/users/e41aecaae2954c4a8a16cacc0029b14d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:03.757983 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014b404-923e-465d-8a82-d84a23058121 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:03.758470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014b404-923e-465d-8a82-d84a23058121 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:03.758659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014b404-923e-465d-8a82-d84a23058121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:03.773501 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:03.780291 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f014b404-923e-465d-8a82-d84a23058121 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:03.781515 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f014b404-923e-465d-8a82-d84a23058121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:03.848429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1376/2749] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:03.863674 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:03.865241 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:03.881477 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:03.934184 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42399e-05f6-4193-b84c-1ece905d9f2a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:03.937942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579f03d-a942-4ab6-8687-1d6e95b585de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:03.938527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579f03d-a942-4ab6-8687-1d6e95b585de service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:03.938815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579f03d-a942-4ab6-8687-1d6e95b585de service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:03.939074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579f03d-a942-4ab6-8687-1d6e95b585de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:03.950298 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579f03d-a942-4ab6-8687-1d6e95b585de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:03.951802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579f03d-a942-4ab6-8687-1d6e95b585de service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:03.963106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1374/2750] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:04.375012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014b404-923e-465d-8a82-d84a23058121 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:04.376743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f014b404-923e-465d-8a82-d84a23058121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:04.396558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014b404-923e-465d-8a82-d84a23058121 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:04.403626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:04.404385 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:04.404665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:04.404982 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] PATH_INFO: `/v3/projects/e51773f35da245c28781a8a1a178bcc0` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:04.406313 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51773f35da245c28781a8a1a178bcc0)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:04.408279 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:04.540082 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51773f35da245c28781a8a1a178bcc0', 'request_id': 'req-894d18d6-d92c-47ea-ab0a-c172351959b3'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:04.546390 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51773f35da245c28781a8a1a178bcc0', 'request_id': 'req-894d18d6-d92c-47ea-ab0a-c172351959b3'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:04.621784 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51773f35da245c28781a8a1a178bcc0', 'request_id': 'req-894d18d6-d92c-47ea-ab0a-c172351959b3'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:04.633822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] The token cache is being invalidate because project e51773f35da245c28781a8a1a178bcc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:04.634104 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:04.635764 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:04.637308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1377/2751] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:04 2022] DELETE /identity/v3/projects/e51773f35da245c28781a8a1a178bcc0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:04.641555 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579f03d-a942-4ab6-8687-1d6e95b585de service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:04.651665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579f03d-a942-4ab6-8687-1d6e95b585de service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:04.709213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:04.709876 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:04.710159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:04.710437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] PATH_INFO: `/v3/users/3c4ac14b16ad4e94993bb2415f938960` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:04.711652 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4ac14b16ad4e94993bb2415f938960)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:04.713686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:04.769147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:04.770943 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:04.785061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d18d6-d92c-47ea-ab0a-c172351959b3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:04.789829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:04.790458 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:04.790734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:04.792249 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] PATH_INFO: `/v3/users/ef4a60c04c3246b69921d251641bdef8` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:04.793494 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4a60c04c3246b69921d251641bdef8)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:04.795531 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:04.911356 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4ac14b16ad4e94993bb2415f938960'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:04.925985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4ac14b16ad4e94993bb2415f938960'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.017641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4a60c04c3246b69921d251641bdef8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.017847 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4a60c04c3246b69921d251641bdef8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.018454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4a60c04c3246b69921d251641bdef8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.030796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4a60c04c3246b69921d251641bdef8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.031927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4ac14b16ad4e94993bb2415f938960'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.045969 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4ac14b16ad4e94993bb2415f938960'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.046649 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-63b79beb-bb92-428c-a855-6ed9d175051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4ac14b16ad4e94993bb2415f938960'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.052587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1375/2752] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:04 2022] DELETE /identity/v3/users/3c4ac14b16ad4e94993bb2415f938960 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:05.111822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4a60c04c3246b69921d251641bdef8'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.126310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1378/2753] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:04 2022] DELETE /identity/v3/users/ef4a60c04c3246b69921d251641bdef8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:05.131931 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865c49-2ecb-4a6c-9d0c-1739df8a6e0a None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:05.132327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865c49-2ecb-4a6c-9d0c-1739df8a6e0a None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:05.132710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865c49-2ecb-4a6c-9d0c-1739df8a6e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:05.152562 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-54865c49-2ecb-4a6c-9d0c-1739df8a6e0a None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:05.153826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-54865c49-2ecb-4a6c-9d0c-1739df8a6e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:05.187675 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:05.217741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1376/2754] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:05.227643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:05.232709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:05.235310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:05.314292 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f780-f122-4f82-b13e-56c5c729441f admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:05.318757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:05.319498 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:05.319829 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:05.320103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:05.329901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:05.331447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:05.342167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1379/2755] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:05.531294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54865c49-2ecb-4a6c-9d0c-1739df8a6e0a None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:05.534106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-54865c49-2ecb-4a6c-9d0c-1739df8a6e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:05.548126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54865c49-2ecb-4a6c-9d0c-1739df8a6e0a None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:05.552825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:05.553483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:05.553763 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:05.554030 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] PATH_INFO: `/v3/projects/f2b386383a2543c3a743e63051ef7166` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:05.555178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b386383a2543c3a743e63051ef7166)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:05.557291 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:05.683716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:05.685190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:05.703474 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f70d7-2821-49d9-be76-a7cdba6f0cab service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:05.717346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:05.718071 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:05.718355 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:05.718626 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] PATH_INFO: `/v3/projects/6352763e6edd4801813eb59cad752e0a` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:05.719809 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6352763e6edd4801813eb59cad752e0a)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:05.721749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:05.722688 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b386383a2543c3a743e63051ef7166', 'request_id': 'req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.728835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b386383a2543c3a743e63051ef7166', 'request_id': 'req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.813620 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b386383a2543c3a743e63051ef7166', 'request_id': 'req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.829800 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] The token cache is being invalidate because project f2b386383a2543c3a743e63051ef7166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:05.830154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.830895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.832785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1377/2756] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:05 2022] DELETE /identity/v3/projects/f2b386383a2543c3a743e63051ef7166 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:05.837025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:05.840039 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:05.840206 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6352763e6edd4801813eb59cad752e0a', 'request_id': 'req-fc9d9427-8bce-4fae-8391-6529a9013fd7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.848315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6352763e6edd4801813eb59cad752e0a', 'request_id': 'req-fc9d9427-8bce-4fae-8391-6529a9013fd7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.909844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb8f29-37f0-405f-aed4-bcb40fe2d4d1 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:05.941073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6352763e6edd4801813eb59cad752e0a', 'request_id': 'req-fc9d9427-8bce-4fae-8391-6529a9013fd7'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.954305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] The token cache is being invalidate because project 6352763e6edd4801813eb59cad752e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:05.954684 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.955379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:05.957020 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1380/2757] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:05 2022] DELETE /identity/v3/projects/6352763e6edd4801813eb59cad752e0a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:05.969368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:05.970159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:05.970345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:05.970593 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] PATH_INFO: `/v3/users/81c6b0b9df314bc48ffa51c45c8f5250` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:05.971838 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c6b0b9df314bc48ffa51c45c8f5250)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:05.973941 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:05.980604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:06.141973 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c6b0b9df314bc48ffa51c45c8f5250'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:06.150770 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c6b0b9df314bc48ffa51c45c8f5250'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:06.203271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c6b0b9df314bc48ffa51c45c8f5250'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:06.216860 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c6b0b9df314bc48ffa51c45c8f5250'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:06.217601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ee6b5c8f-5143-442f-9dac-2b0be8f5d1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c6b0b9df314bc48ffa51c45c8f5250'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:06.223858 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1378/2758] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:05 2022] DELETE /identity/v3/users/81c6b0b9df314bc48ffa51c45c8f5250 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:06.695195 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:06.696615 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:06.710250 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9427-8bce-4fae-8391-6529a9013fd7 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:06.775887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:06.776561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:06.776870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:06.777244 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] PATH_INFO: `/v3/projects/e9ee4ae7024549f9b810da746cb89410` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:06.778397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ee4ae7024549f9b810da746cb89410)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:06.780310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:06.881421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:06.898962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ee4ae7024549f9b810da746cb89410', 'request_id': 'req-8e329b11-f787-4590-9271-6d1c6c6c1ef1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:06.905623 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ee4ae7024549f9b810da746cb89410', 'request_id': 'req-8e329b11-f787-4590-9271-6d1c6c6c1ef1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:07.014874 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ee4ae7024549f9b810da746cb89410', 'request_id': 'req-8e329b11-f787-4590-9271-6d1c6c6c1ef1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:07.026937 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] The token cache is being invalidate because project e9ee4ae7024549f9b810da746cb89410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:07.027248 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:07.028169 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-8e329b11-f787-4590-9271-6d1c6c6c1ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:07.029750 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1381/2759] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:06 2022] DELETE /identity/v3/projects/e9ee4ae7024549f9b810da746cb89410 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:07.034974 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5742-ec3d-4187-9cdd-5c81fdc6b1fa None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.035890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5742-ec3d-4187-9cdd-5c81fdc6b1fa None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.035890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5742-ec3d-4187-9cdd-5c81fdc6b1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.057501 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-953e5742-ec3d-4187-9cdd-5c81fdc6b1fa None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:07.058215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-953e5742-ec3d-4187-9cdd-5c81fdc6b1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:07.126591 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1379/2760] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:07.135026 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc762-463e-491e-bc7b-2a8e4768c0be None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.135310 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc762-463e-491e-bc7b-2a8e4768c0be None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.135583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc762-463e-491e-bc7b-2a8e4768c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.157561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-c63cc762-463e-491e-bc7b-2a8e4768c0be None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:07.158842 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c63cc762-463e-491e-bc7b-2a8e4768c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:07.167579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1382/2761] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:07.173489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e5742-ec3d-4187-9cdd-5c81fdc6b1fa None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:07.183271 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e5742-ec3d-4187-9cdd-5c81fdc6b1fa None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:07.190246 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:07.190862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.191137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.191406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.192102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:32:07.192403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:07.194078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:07.207374 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1380/2762] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:32:07.211991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cc762-463e-491e-bc7b-2a8e4768c0be None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:07.223173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cc762-463e-491e-bc7b-2a8e4768c0be None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:07.227836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283d759-1f01-4045-be4e-4d3c73510e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:07.228456 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d759-1f01-4045-be4e-4d3c73510e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.228735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d759-1f01-4045-be4e-4d3c73510e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.229049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283d759-1f01-4045-be4e-4d3c73510e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.229716 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283d759-1f01-4045-be4e-4d3c73510e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:07.231656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283d759-1f01-4045-be4e-4d3c73510e07 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:07.347346 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1383/2763] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:32:07 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:07.352048 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:07.362486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d9fe1-664a-4544-b5c7-cf88cb0dbfb3 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:07.422561 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8150a-9bc5-4a17-bbe7-6ff497625a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:07.423863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8150a-9bc5-4a17-bbe7-6ff497625a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.424317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8150a-9bc5-4a17-bbe7-6ff497625a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.424811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8150a-9bc5-4a17-bbe7-6ff497625a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.426023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8150a-9bc5-4a17-bbe7-6ff497625a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:07.429518 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8150a-9bc5-4a17-bbe7-6ff497625a69 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:07.539643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:07.543334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1381/2764] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:32:07 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:07.550031 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283d759-1f01-4045-be4e-4d3c73510e07 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:07.561148 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283d759-1f01-4045-be4e-4d3c73510e07 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:07.565763 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfc38e-ab02-48e0-b727-d9fd6eb98033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:07.568493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfc38e-ab02-48e0-b727-d9fd6eb98033 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.568493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfc38e-ab02-48e0-b727-d9fd6eb98033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.568493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfc38e-ab02-48e0-b727-d9fd6eb98033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.568493 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfc38e-ab02-48e0-b727-d9fd6eb98033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:07.569283 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfc38e-ab02-48e0-b727-d9fd6eb98033 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:07.579536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1384/2765] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:07.583585 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8150a-9bc5-4a17-bbe7-6ff497625a69 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:07.594531 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8150a-9bc5-4a17-bbe7-6ff497625a69 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:07.600154 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a03f3-3b99-417c-9933-30606254ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:07.610662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a03f3-3b99-417c-9933-30606254ff6c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.610662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a03f3-3b99-417c-9933-30606254ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.610662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a03f3-3b99-417c-9933-30606254ff6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.610662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a03f3-3b99-417c-9933-30606254ff6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:07.610662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a03f3-3b99-417c-9933-30606254ff6c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:07.618314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1382/2766] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:07.623164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfc38e-ab02-48e0-b727-d9fd6eb98033 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:07.633297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfc38e-ab02-48e0-b727-d9fd6eb98033 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:07.637866 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:07.638641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.638941 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.639300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] PATH_INFO: `/v3/projects/6d653a494a3d4fb693a58c000750ba2c/users/9c131d1e0c684d9eb83b388c2946bb0f/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.655931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d653a494a3d4fb693a58c000750ba2c, user_id=9c131d1e0c684d9eb83b388c2946bb0f, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:07.658628 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:07.718309 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1385/2767] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:07 2022] PUT /identity/v3/projects/6d653a494a3d4fb693a58c000750ba2c/users/9c131d1e0c684d9eb83b388c2946bb0f/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:07.723642 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90cdeb-3084-4e44-95ec-938a2472dfa4 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.723929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90cdeb-3084-4e44-95ec-938a2472dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.724208 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90cdeb-3084-4e44-95ec-938a2472dfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.743835 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-1c90cdeb-3084-4e44-95ec-938a2472dfa4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:07.745078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-1c90cdeb-3084-4e44-95ec-938a2472dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:07.808442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1383/2768] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:07.818899 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:07.820641 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:07.877871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6e609-89a8-412b-9cc0-68403ee579b6 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:07.881535 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab53ec-f1ee-446a-8428-4c282ed76837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:07.882146 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab53ec-f1ee-446a-8428-4c282ed76837 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:07.882425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab53ec-f1ee-446a-8428-4c282ed76837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:07.882698 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab53ec-f1ee-446a-8428-4c282ed76837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:07.892598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab53ec-f1ee-446a-8428-4c282ed76837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:07.894091 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab53ec-f1ee-446a-8428-4c282ed76837 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:07.903960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1386/2769] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:13.834983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaae8f-30da-46ca-91f5-27cc9ec179a9 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:13.835483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaae8f-30da-46ca-91f5-27cc9ec179a9 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:13.835596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaae8f-30da-46ca-91f5-27cc9ec179a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:13.866316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-95eaae8f-30da-46ca-91f5-27cc9ec179a9 None None] MFA Rules not processed for user `9c131d1e0c684d9eb83b388c2946bb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:13.866886 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-95eaae8f-30da-46ca-91f5-27cc9ec179a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:13.938296 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1384/2770] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:13.941352 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab53ec-f1ee-446a-8428-4c282ed76837 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:13.951601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab53ec-f1ee-446a-8428-4c282ed76837 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:13.958859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6eaaa-cd59-4953-96f3-59346199d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:13.958859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6eaaa-cd59-4953-96f3-59346199d98c admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:13.958859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6eaaa-cd59-4953-96f3-59346199d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:13.958859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6eaaa-cd59-4953-96f3-59346199d98c admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:13.959335 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6eaaa-cd59-4953-96f3-59346199d98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:13.959853 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6eaaa-cd59-4953-96f3-59346199d98c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:14.052971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1387/2771] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:32:13 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:14.057464 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaae8f-30da-46ca-91f5-27cc9ec179a9 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:14.069203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaae8f-30da-46ca-91f5-27cc9ec179a9 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:14.141621 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf395981-a8e6-4881-bfb3-d7a5d58f6550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:14.142231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395981-a8e6-4881-bfb3-d7a5d58f6550 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:14.142516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395981-a8e6-4881-bfb3-d7a5d58f6550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:14.142778 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395981-a8e6-4881-bfb3-d7a5d58f6550 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:14.143479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395981-a8e6-4881-bfb3-d7a5d58f6550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:14.145832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395981-a8e6-4881-bfb3-d7a5d58f6550 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:14.225401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1385/2772] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:32:14 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:14.229470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6eaaa-cd59-4953-96f3-59346199d98c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:14.240858 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6eaaa-cd59-4953-96f3-59346199d98c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:14.245710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e32ad-50b2-4d43-8e85-54875edf08da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:14.246320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e32ad-50b2-4d43-8e85-54875edf08da admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:14.246600 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e32ad-50b2-4d43-8e85-54875edf08da admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:14.246877 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e32ad-50b2-4d43-8e85-54875edf08da admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:14.247562 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e32ad-50b2-4d43-8e85-54875edf08da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:14.250077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e32ad-50b2-4d43-8e85-54875edf08da admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:14.261905 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1388/2773] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:14.267220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf395981-a8e6-4881-bfb3-d7a5d58f6550 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:14.283300 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf395981-a8e6-4881-bfb3-d7a5d58f6550 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:14.298977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099135ad-6158-4fea-b391-173f658bc533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:14.299713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099135ad-6158-4fea-b391-173f658bc533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:14.300026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099135ad-6158-4fea-b391-173f658bc533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:14.300343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099135ad-6158-4fea-b391-173f658bc533 admin admin] PATH_INFO: `/v3/projects/e8dc893a3ca149049f25bde29b65915c/users/2d866ea12e164881a4bc5d7c7b73828c/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:14.304287 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:14.318846 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099135ad-6158-4fea-b391-173f658bc533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dc893a3ca149049f25bde29b65915c, user_id=2d866ea12e164881a4bc5d7c7b73828c, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:14.321618 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099135ad-6158-4fea-b391-173f658bc533 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:14.407348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1386/2774] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:14 2022] PUT /identity/v3/projects/e8dc893a3ca149049f25bde29b65915c/users/2d866ea12e164881a4bc5d7c7b73828c/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:14.408365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e32ad-50b2-4d43-8e85-54875edf08da admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:14.419727 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e32ad-50b2-4d43-8e85-54875edf08da admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:14.442546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:14.481429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ee4b6-fbab-4a73-a7e8-21361835b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:14.482126 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee4b6-fbab-4a73-a7e8-21361835b591 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:14.483391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee4b6-fbab-4a73-a7e8-21361835b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:14.483931 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee4b6-fbab-4a73-a7e8-21361835b591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:14.485032 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ee4b6-fbab-4a73-a7e8-21361835b591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:14.486890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ee4b6-fbab-4a73-a7e8-21361835b591 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:14.501240 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1389/2775] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:14.502666 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099135ad-6158-4fea-b391-173f658bc533 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:14.516426 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099135ad-6158-4fea-b391-173f658bc533 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:14.522067 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:14.522854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:14.523040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:14.523341 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] PATH_INFO: `/v3/projects/e8dc893a3ca149049f25bde29b65915c/users/2d866ea12e164881a4bc5d7c7b73828c/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:14.525543 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dc893a3ca149049f25bde29b65915c, user_id=2d866ea12e164881a4bc5d7c7b73828c, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:14.528290 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:14.539912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1387/2776] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:14 2022] PUT /identity/v3/projects/e8dc893a3ca149049f25bde29b65915c/users/2d866ea12e164881a4bc5d7c7b73828c/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:20.393989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca5957-925f-4056-8460-f00e7c5a559e None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:20.393989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca5957-925f-4056-8460-f00e7c5a559e None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:20.393989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca5957-925f-4056-8460-f00e7c5a559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:20.438849 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-01ca5957-925f-4056-8460-f00e7c5a559e None None] MFA Rules not processed for user `2d866ea12e164881a4bc5d7c7b73828c`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:20.440734 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-01ca5957-925f-4056-8460-f00e7c5a559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:20.542174 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1390/2777] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:20.558085 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:20.559868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:20.720980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199a00-0f4a-4210-bf7d-bd0fd790daa5 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:20.726490 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:20.727102 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:20.727377 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:20.727645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:20.793338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:20.796802 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:20.806003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1388/2778] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:23.596978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af0c1b-a5c6-4658-90d6-c62b7d4e32fe None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:23.597867 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af0c1b-a5c6-4658-90d6-c62b7d4e32fe None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:23.598300 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af0c1b-a5c6-4658-90d6-c62b7d4e32fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:23.620021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-f6af0c1b-a5c6-4658-90d6-c62b7d4e32fe None None] MFA Rules not processed for user `9c131d1e0c684d9eb83b388c2946bb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:23.621280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-f6af0c1b-a5c6-4658-90d6-c62b7d4e32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:23.633959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1391/2779] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:25.300960 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:25.302716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:25.305862 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:25.404643 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ce06-9435-405c-8b36-2cb5a0f775ce service nova] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:25.413051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:25.413051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:25.413051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:25.413051 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] PATH_INFO: `/v3/users/0c9304ddb8f9479da987738b65e0f87c` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:25.413469 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9304ddb8f9479da987738b65e0f87c)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:25.413912 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:25.652581 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9304ddb8f9479da987738b65e0f87c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:25.659764 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9304ddb8f9479da987738b65e0f87c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:25.734700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9304ddb8f9479da987738b65e0f87c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:25.749632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9304ddb8f9479da987738b65e0f87c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:25.750362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9304ddb8f9479da987738b65e0f87c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:25.756368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1389/2780] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:25 2022] DELETE /identity/v3/users/0c9304ddb8f9479da987738b65e0f87c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:25.760963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0263a-611d-43c7-9a46-4b867cbf8b1b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:25.761479 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0263a-611d-43c7-9a46-4b867cbf8b1b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:25.761585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0263a-611d-43c7-9a46-4b867cbf8b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:25.794196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-72d0263a-611d-43c7-9a46-4b867cbf8b1b None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:25.794196 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-72d0263a-611d-43c7-9a46-4b867cbf8b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:25.846935 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=100 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:25.855316 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1392/2781] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:25.866099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:25.867486 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:25.912021 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0263a-611d-43c7-9a46-4b867cbf8b1b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:25.913466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-72d0263a-611d-43c7-9a46-4b867cbf8b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:25.926994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0263a-611d-43c7-9a46-4b867cbf8b1b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:25.931933 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:25.932561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:25.932856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:25.933154 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] PATH_INFO: `/v3/users/e25d70309a7d427584c643b7f0e09f81` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:25.933956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e79d7-b1d2-492f-ad39-ab18a89d09b4 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:25.934325 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25d70309a7d427584c643b7f0e09f81)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:25.936985 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:25.938026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a7a4e-61c3-4c9a-8a71-2112d95d10e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:25.938645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a7a4e-61c3-4c9a-8a71-2112d95d10e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:25.938927 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a7a4e-61c3-4c9a-8a71-2112d95d10e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:25.939203 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a7a4e-61c3-4c9a-8a71-2112d95d10e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:25.946571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:25.949072 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a7a4e-61c3-4c9a-8a71-2112d95d10e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:25.950541 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a7a4e-61c3-4c9a-8a71-2112d95d10e7 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:25.961242 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1390/2782] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:26.119383 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25d70309a7d427584c643b7f0e09f81'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.120100 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25d70309a7d427584c643b7f0e09f81'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.120726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25d70309a7d427584c643b7f0e09f81'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.135421 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25d70309a7d427584c643b7f0e09f81'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.196033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25d70309a7d427584c643b7f0e09f81'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.210226 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1393/2783] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:25 2022] DELETE /identity/v3/users/e25d70309a7d427584c643b7f0e09f81 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:26.214632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9a1f8-1b86-489c-ae8e-77a683ac0ebc None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:26.214925 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9a1f8-1b86-489c-ae8e-77a683ac0ebc None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:26.215198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9a1f8-1b86-489c-ae8e-77a683ac0ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:26.239076 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-18c9a1f8-1b86-489c-ae8e-77a683ac0ebc None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:26.240351 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-18c9a1f8-1b86-489c-ae8e-77a683ac0ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:26.306397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1391/2784] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:26.316162 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:26.317592 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:26.389989 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65a04-8612-4323-9322-5df244660623 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:26.390199 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9a1f8-1b86-489c-ae8e-77a683ac0ebc None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:26.392459 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-18c9a1f8-1b86-489c-ae8e-77a683ac0ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:26.392717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974fa5c-5bb4-4d05-9f18-25198e9cbf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:26.393413 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fa5c-5bb4-4d05-9f18-25198e9cbf84 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:26.393696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fa5c-5bb4-4d05-9f18-25198e9cbf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:26.393970 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fa5c-5bb4-4d05-9f18-25198e9cbf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:26.405547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974fa5c-5bb4-4d05-9f18-25198e9cbf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:26.407247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974fa5c-5bb4-4d05-9f18-25198e9cbf84 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:26.408679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9a1f8-1b86-489c-ae8e-77a683ac0ebc None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:26.423056 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1394/2785] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:26.423517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:26.423517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:26.423517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:26.423517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] PATH_INFO: `/v3/projects/67607f5aaea940ae81eed5095eedd2c0` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:26.423842 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=67607f5aaea940ae81eed5095eedd2c0)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:26.425008 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:26.586095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67607f5aaea940ae81eed5095eedd2c0', 'request_id': 'req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.594657 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67607f5aaea940ae81eed5095eedd2c0', 'request_id': 'req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.659987 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67607f5aaea940ae81eed5095eedd2c0', 'request_id': 'req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.673318 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] The token cache is being invalidate because project 67607f5aaea940ae81eed5095eedd2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:26.673614 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.674285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-cd98700f-1f0a-4a53-8c43-65f04cd96aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:26.676090 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1392/2786] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:26 2022] DELETE /identity/v3/projects/67607f5aaea940ae81eed5095eedd2c0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:26.681590 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80f0f0-6a5b-43ca-8908-0e7397a30043 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:26.681892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80f0f0-6a5b-43ca-8908-0e7397a30043 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:26.682262 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80f0f0-6a5b-43ca-8908-0e7397a30043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:26.742530 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-7f80f0f0-6a5b-43ca-8908-0e7397a30043 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:26.743791 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7f80f0f0-6a5b-43ca-8908-0e7397a30043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:26.790797 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:26.805267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1395/2787] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:26.814979 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebadda-a1e9-4b7a-8dfd-8c7a7a7a8e8d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:26.815423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebadda-a1e9-4b7a-8dfd-8c7a7a7a8e8d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:26.815704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebadda-a1e9-4b7a-8dfd-8c7a7a7a8e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:26.839138 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-0cebadda-a1e9-4b7a-8dfd-8c7a7a7a8e8d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:26.843776 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80f0f0-6a5b-43ca-8908-0e7397a30043 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:26.843952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0cebadda-a1e9-4b7a-8dfd-8c7a7a7a8e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:26.844065 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-7f80f0f0-6a5b-43ca-8908-0e7397a30043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:26.853560 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1393/2788] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:26.853819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80f0f0-6a5b-43ca-8908-0e7397a30043 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:26.854461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebadda-a1e9-4b7a-8dfd-8c7a7a7a8e8d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:26.864951 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebadda-a1e9-4b7a-8dfd-8c7a7a7a8e8d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:26.870480 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:26.877918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:26.877918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:26.877918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] PATH_INFO: `/v3/domains` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:26.878588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:26.879194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80841) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:32:26.879194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:26.879760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:26.879760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:26.879760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] PATH_INFO: `/v3/projects/f4c9ecdc4cdb44278f7879df456d4313` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:26.880264 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:26.880357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c9ecdc4cdb44278f7879df456d4313)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:26.880357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:26.894314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1394/2789] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:32:26.898903 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:26.910503 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3130-ff00-4e27-a573-8d287cebc821 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:26.915360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f69fe1-29d4-44b3-a8dc-0a8a7126195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:26.915988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69fe1-29d4-44b3-a8dc-0a8a7126195f admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:26.916273 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69fe1-29d4-44b3-a8dc-0a8a7126195f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:26.916548 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69fe1-29d4-44b3-a8dc-0a8a7126195f admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:26.917269 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f69fe1-29d4-44b3-a8dc-0a8a7126195f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:26.919159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f69fe1-29d4-44b3-a8dc-0a8a7126195f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:26.998617 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c9ecdc4cdb44278f7879df456d4313', 'request_id': 'req-bfc3e824-628d-402e-973b-44a604520fdf'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:27.004748 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c9ecdc4cdb44278f7879df456d4313', 'request_id': 'req-bfc3e824-628d-402e-973b-44a604520fdf'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:27.056644 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1395/2790] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:32:26 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:32:27.061023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f69fe1-29d4-44b3-a8dc-0a8a7126195f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.077945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c9ecdc4cdb44278f7879df456d4313', 'request_id': 'req-bfc3e824-628d-402e-973b-44a604520fdf'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:27.091341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] The token cache is being invalidate because project f4c9ecdc4cdb44278f7879df456d4313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:27.092168 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:27.092932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-bfc3e824-628d-402e-973b-44a604520fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:27.098057 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1396/2791] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:26 2022] DELETE /identity/v3/projects/f4c9ecdc4cdb44278f7879df456d4313 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:27.102823 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce632-0db6-4486-99dd-f2b687c40082 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce632-0db6-4486-99dd-f2b687c40082 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.114642 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce632-0db6-4486-99dd-f2b687c40082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.114872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:27.123747 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-697ce632-0db6-4486-99dd-f2b687c40082 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:27.125703 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-697ce632-0db6-4486-99dd-f2b687c40082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:27.134527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1397/2792] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:27.138027 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f69fe1-29d4-44b3-a8dc-0a8a7126195f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.142964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d00a6-0a2f-4be5-aa5b-72085e579805 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.143949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d00a6-0a2f-4be5-aa5b-72085e579805 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.144064 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.144173 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d00a6-0a2f-4be5-aa5b-72085e579805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.144254 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.144331 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.144564 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.145259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.147517 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.164634 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b21d00a6-0a2f-4be5-aa5b-72085e579805 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:27.165958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b21d00a6-0a2f-4be5-aa5b-72085e579805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:27.174315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1398/2793] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:27.178486 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d00a6-0a2f-4be5-aa5b-72085e579805 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.187495 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d00a6-0a2f-4be5-aa5b-72085e579805 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.193033 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.193664 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.193983 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.194237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.194949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:32:27.195276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.196914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.209586 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1399/2794] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:32:27.213955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.224934 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a2493-629e-497e-a104-f3e0c97725a9 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.229767 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb13f2-5b84-4d48-81bf-5f1943eedadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.230417 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb13f2-5b84-4d48-81bf-5f1943eedadc admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.230659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb13f2-5b84-4d48-81bf-5f1943eedadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.230929 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb13f2-5b84-4d48-81bf-5f1943eedadc admin admin] PATH_INFO: `/v3/projects` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.231588 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb13f2-5b84-4d48-81bf-5f1943eedadc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.233609 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb13f2-5b84-4d48-81bf-5f1943eedadc admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.260519 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1396/2795] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:32:27.265408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.267506 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:27.280375 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f09c1-7d7e-45d3-b267-1a845a122f6e admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.285207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1a7bc-8e6d-4a85-95a7-eaf283f5fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.285805 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1a7bc-8e6d-4a85-95a7-eaf283f5fbce admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.286080 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1a7bc-8e6d-4a85-95a7-eaf283f5fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.286348 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1a7bc-8e6d-4a85-95a7-eaf283f5fbce admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.287037 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1a7bc-8e6d-4a85-95a7-eaf283f5fbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.288615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1a7bc-8e6d-4a85-95a7-eaf283f5fbce admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.298741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1397/2796] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:27.302529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1a7bc-8e6d-4a85-95a7-eaf283f5fbce admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.312379 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1a7bc-8e6d-4a85-95a7-eaf283f5fbce admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.317005 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dc95c-5b82-46f6-8511-45a06dbea1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.317580 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dc95c-5b82-46f6-8511-45a06dbea1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.317857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dc95c-5b82-46f6-8511-45a06dbea1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.318127 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dc95c-5b82-46f6-8511-45a06dbea1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.318793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dc95c-5b82-46f6-8511-45a06dbea1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.320335 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dc95c-5b82-46f6-8511-45a06dbea1e8 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.331192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1398/2797] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:32:27.335309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dc95c-5b82-46f6-8511-45a06dbea1e8 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.345546 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dc95c-5b82-46f6-8511-45a06dbea1e8 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.351876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1400/2798] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:32:27.352026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d3959-2460-4471-827b-156ec095025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.352026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3959-2460-4471-827b-156ec095025d admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.352026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3959-2460-4471-827b-156ec095025d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.352026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d3959-2460-4471-827b-156ec095025d admin admin] PATH_INFO: `/v3/projects/819c095299f44de08af80abc22cf8d53/users/05d5d4c4cd60482e9da867ad4b7bfbe1/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.355813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb13f2-5b84-4d48-81bf-5f1943eedadc admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.371207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d3959-2460-4471-827b-156ec095025d admin admin] RBAC: Authorizing `identity:create_grant(project_id=819c095299f44de08af80abc22cf8d53, user_id=05d5d4c4cd60482e9da867ad4b7bfbe1, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.374995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d3959-2460-4471-827b-156ec095025d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.423261 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb13f2-5b84-4d48-81bf-5f1943eedadc admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.428164 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8510-7668-4fe4-b609-f81f47af6571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.428775 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8510-7668-4fe4-b609-f81f47af6571 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.429076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8510-7668-4fe4-b609-f81f47af6571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.429343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8510-7668-4fe4-b609-f81f47af6571 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.429993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8510-7668-4fe4-b609-f81f47af6571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.431891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8510-7668-4fe4-b609-f81f47af6571 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.452676 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1399/2799] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:27 2022] PUT /identity/v3/projects/819c095299f44de08af80abc22cf8d53/users/05d5d4c4cd60482e9da867ad4b7bfbe1/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:27.462832 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe367a-5d4a-4201-8d04-5c96a73cd415 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.463116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe367a-5d4a-4201-8d04-5c96a73cd415 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.463389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe367a-5d4a-4201-8d04-5c96a73cd415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.492079 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-68fe367a-5d4a-4201-8d04-5c96a73cd415 None None] MFA Rules not processed for user `05d5d4c4cd60482e9da867ad4b7bfbe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:27.499587 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-68fe367a-5d4a-4201-8d04-5c96a73cd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:27.536320 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1401/2800] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:27.537993 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8510-7668-4fe4-b609-f81f47af6571 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.548957 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8510-7668-4fe4-b609-f81f47af6571 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.563793 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:27.582712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1400/2801] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:27.587103 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe367a-5d4a-4201-8d04-5c96a73cd415 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.616268 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665aff5-912e-4fbd-9388-f6f3f5d8c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.616963 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665aff5-912e-4fbd-9388-f6f3f5d8c7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.617345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665aff5-912e-4fbd-9388-f6f3f5d8c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.617625 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665aff5-912e-4fbd-9388-f6f3f5d8c7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.618682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665aff5-912e-4fbd-9388-f6f3f5d8c7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.619942 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665aff5-912e-4fbd-9388-f6f3f5d8c7cf admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.635949 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1402/2802] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:32:27.637766 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665aff5-912e-4fbd-9388-f6f3f5d8c7cf admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.651887 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665aff5-912e-4fbd-9388-f6f3f5d8c7cf admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.658838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c43c9-fb44-4f01-ba73-a8b17718d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.659577 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c43c9-fb44-4f01-ba73-a8b17718d6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.659859 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c43c9-fb44-4f01-ba73-a8b17718d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.660134 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c43c9-fb44-4f01-ba73-a8b17718d6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.660980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c43c9-fb44-4f01-ba73-a8b17718d6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.662854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c43c9-fb44-4f01-ba73-a8b17718d6b3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.665479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe367a-5d4a-4201-8d04-5c96a73cd415 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.671279 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff062-cd41-40b5-8e98-6f3cb2fe06b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.671983 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff062-cd41-40b5-8e98-6f3cb2fe06b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.672270 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff062-cd41-40b5-8e98-6f3cb2fe06b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.672545 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff062-cd41-40b5-8e98-6f3cb2fe06b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.673261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff062-cd41-40b5-8e98-6f3cb2fe06b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.675684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff062-cd41-40b5-8e98-6f3cb2fe06b2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.680270 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1403/2803] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:27.684618 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c43c9-fb44-4f01-ba73-a8b17718d6b3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.696165 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:27.697171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c43c9-fb44-4f01-ba73-a8b17718d6b3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.702710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b52d-4b9d-4f2a-ab3b-f2f66a3e6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.703465 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b52d-4b9d-4f2a-ab3b-f2f66a3e6d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.703743 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b52d-4b9d-4f2a-ab3b-f2f66a3e6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.704045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b52d-4b9d-4f2a-ab3b-f2f66a3e6d9a admin admin] PATH_INFO: `/v3/projects/84f552d4dc2c440a8ca61ecbb045d9c2/users/d78960742f444b68b1a47fa922a8f890/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.720693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b52d-4b9d-4f2a-ab3b-f2f66a3e6d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f552d4dc2c440a8ca61ecbb045d9c2, user_id=d78960742f444b68b1a47fa922a8f890, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.723491 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b52d-4b9d-4f2a-ab3b-f2f66a3e6d9a admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.789632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1401/2804] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:32:27.792659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff062-cd41-40b5-8e98-6f3cb2fe06b2 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.815422 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1404/2805] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:27 2022] PUT /identity/v3/projects/84f552d4dc2c440a8ca61ecbb045d9c2/users/d78960742f444b68b1a47fa922a8f890/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:27.826969 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f066-ae64-4b68-b0e1-0400a172f34b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.827314 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f066-ae64-4b68-b0e1-0400a172f34b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.827594 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456f066-ae64-4b68-b0e1-0400a172f34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.856120 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-4456f066-ae64-4b68-b0e1-0400a172f34b None None] MFA Rules not processed for user `d78960742f444b68b1a47fa922a8f890`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:27.857416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4456f066-ae64-4b68-b0e1-0400a172f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:27.861913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff062-cd41-40b5-8e98-6f3cb2fe06b2 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:27.928921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1405/2806] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:27.930466 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644c7c9-7004-4322-b8c9-091b8fbb1b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:27.931362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644c7c9-7004-4322-b8c9-091b8fbb1b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:27.931362 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644c7c9-7004-4322-b8c9-091b8fbb1b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:27.931625 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644c7c9-7004-4322-b8c9-091b8fbb1b38 admin admin] PATH_INFO: `/v3/users` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:27.932314 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644c7c9-7004-4322-b8c9-091b8fbb1b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:27.934342 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644c7c9-7004-4322-b8c9-091b8fbb1b38 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:27.940216 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f066-ae64-4b68-b0e1-0400a172f34b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:27.941579 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-4456f066-ae64-4b68-b0e1-0400a172f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:27.999378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456f066-ae64-4b68-b0e1-0400a172f34b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.003027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b71a7-1bee-4e72-827a-030a59b2798f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.003643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b71a7-1bee-4e72-827a-030a59b2798f service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.003920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b71a7-1bee-4e72-827a-030a59b2798f service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.004190 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b71a7-1bee-4e72-827a-030a59b2798f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.012938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b71a7-1bee-4e72-827a-030a59b2798f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.015123 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b71a7-1bee-4e72-827a-030a59b2798f service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.024901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1406/2807] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:32:28.051446 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b71a7-1bee-4e72-827a-030a59b2798f service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.062558 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b71a7-1bee-4e72-827a-030a59b2798f service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.067610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.068267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.068541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.068811 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] PATH_INFO: `/v3/users/d78960742f444b68b1a47fa922a8f890` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.070044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78960742f444b68b1a47fa922a8f890)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.072153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.075103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:28.086660 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1402/2808] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:32:27 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:32:28.088036 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644c7c9-7004-4322-b8c9-091b8fbb1b38 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.098146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644c7c9-7004-4322-b8c9-091b8fbb1b38 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.102826 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88cc1-201d-40df-a78e-6af446a73b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.103440 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88cc1-201d-40df-a78e-6af446a73b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.103719 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88cc1-201d-40df-a78e-6af446a73b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.103992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88cc1-201d-40df-a78e-6af446a73b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.104681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f88cc1-201d-40df-a78e-6af446a73b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.106359 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f88cc1-201d-40df-a78e-6af446a73b57 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.116713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1403/2809] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:32:28.120584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88cc1-201d-40df-a78e-6af446a73b57 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.130980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88cc1-201d-40df-a78e-6af446a73b57 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.135572 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1695-ce7d-45d3-a73f-a2ed37cc9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.136159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1695-ce7d-45d3-a73f-a2ed37cc9cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.136436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1695-ce7d-45d3-a73f-a2ed37cc9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.136724 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1695-ce7d-45d3-a73f-a2ed37cc9cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.137406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1695-ce7d-45d3-a73f-a2ed37cc9cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.139659 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1695-ce7d-45d3-a73f-a2ed37cc9cdf admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.151632 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1404/2810] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:32:28.155744 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1695-ce7d-45d3-a73f-a2ed37cc9cdf admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.165656 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1695-ce7d-45d3-a73f-a2ed37cc9cdf admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.171196 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eac8de-0341-4ef0-82fb-b2f5d1c14d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.171829 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eac8de-0341-4ef0-82fb-b2f5d1c14d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.176686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eac8de-0341-4ef0-82fb-b2f5d1c14d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.176686 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eac8de-0341-4ef0-82fb-b2f5d1c14d03 admin admin] PATH_INFO: `/v3/projects/99f0f2e2e1224918a3d7ac8bc18ab62d/users/06cb3dc6e8744893adaececf922c9038/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.187909 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eac8de-0341-4ef0-82fb-b2f5d1c14d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f0f2e2e1224918a3d7ac8bc18ab62d, user_id=06cb3dc6e8744893adaececf922c9038, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.190697 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eac8de-0341-4ef0-82fb-b2f5d1c14d03 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.269726 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78960742f444b68b1a47fa922a8f890'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:28.270752 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78960742f444b68b1a47fa922a8f890'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:28.271477 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78960742f444b68b1a47fa922a8f890'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:28.283509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78960742f444b68b1a47fa922a8f890'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:28.289256 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1405/2811] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:28 2022] PUT /identity/v3/projects/99f0f2e2e1224918a3d7ac8bc18ab62d/users/06cb3dc6e8744893adaececf922c9038/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:28.300112 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882c9cb-2308-4e0a-930f-c42f48d8a2e2 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.300403 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882c9cb-2308-4e0a-930f-c42f48d8a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.300680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882c9cb-2308-4e0a-930f-c42f48d8a2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.330705 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-e882c9cb-2308-4e0a-930f-c42f48d8a2e2 None None] MFA Rules not processed for user `06cb3dc6e8744893adaececf922c9038`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:28.331992 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e882c9cb-2308-4e0a-930f-c42f48d8a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:28.367252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:28.378806 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b0545b25-f1d9-4879-b3c8-521f7a94a99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78960742f444b68b1a47fa922a8f890'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:28.392701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1407/2812] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:28 2022] DELETE /identity/v3/users/d78960742f444b68b1a47fa922a8f890 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:28.398042 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabd596-bb75-4f86-9edf-57de281588a9 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.398381 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabd596-bb75-4f86-9edf-57de281588a9 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.398656 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabd596-bb75-4f86-9edf-57de281588a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.403729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1406/2813] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:28.408357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882c9cb-2308-4e0a-930f-c42f48d8a2e2 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.409779 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-e882c9cb-2308-4e0a-930f-c42f48d8a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:28.419746 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6eabd596-bb75-4f86-9edf-57de281588a9 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:28.421884 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6eabd596-bb75-4f86-9edf-57de281588a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:28.488836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882c9cb-2308-4e0a-930f-c42f48d8a2e2 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.489308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1408/2814] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:28.494823 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d3628-bde1-42d5-8934-f5db682cbe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.495289 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3628-bde1-42d5-8934-f5db682cbe97 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.495567 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3628-bde1-42d5-8934-f5db682cbe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.495836 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3628-bde1-42d5-8934-f5db682cbe97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.496504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d3628-bde1-42d5-8934-f5db682cbe97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.499194 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d3628-bde1-42d5-8934-f5db682cbe97 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.500928 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabd596-bb75-4f86-9edf-57de281588a9 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.502374 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6eabd596-bb75-4f86-9edf-57de281588a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:28.561587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabd596-bb75-4f86-9edf-57de281588a9 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.565354 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46a99c-542f-47a6-b181-c8cb7be8555d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.565922 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a99c-542f-47a6-b181-c8cb7be8555d service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.566201 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a99c-542f-47a6-b181-c8cb7be8555d service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.566470 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a99c-542f-47a6-b181-c8cb7be8555d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.575415 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46a99c-542f-47a6-b181-c8cb7be8555d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.577207 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46a99c-542f-47a6-b181-c8cb7be8555d service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.586622 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1409/2815] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:28.604249 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1407/2816] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:32:28 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:32:28.608939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46a99c-542f-47a6-b181-c8cb7be8555d service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.619906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46a99c-542f-47a6-b181-c8cb7be8555d service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.642058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:28.681034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79f8d-7d3d-43cc-b73c-8b9d6e8ad8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.681657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f8d-7d3d-43cc-b73c-8b9d6e8ad8dc admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.681936 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f8d-7d3d-43cc-b73c-8b9d6e8ad8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.682210 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f8d-7d3d-43cc-b73c-8b9d6e8ad8dc admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.682897 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79f8d-7d3d-43cc-b73c-8b9d6e8ad8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.684902 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79f8d-7d3d-43cc-b73c-8b9d6e8ad8dc admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.782573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1410/2817] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:32:28 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:28.786870 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d3628-bde1-42d5-8934-f5db682cbe97 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.798406 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d3628-bde1-42d5-8934-f5db682cbe97 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.803266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca2b3e-4dd6-49bb-95cc-cede723125c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.803890 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2b3e-4dd6-49bb-95cc-cede723125c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.804171 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2b3e-4dd6-49bb-95cc-cede723125c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.804441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca2b3e-4dd6-49bb-95cc-cede723125c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.805192 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca2b3e-4dd6-49bb-95cc-cede723125c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.806783 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca2b3e-4dd6-49bb-95cc-cede723125c2 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.818078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1408/2818] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:28.822837 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79f8d-7d3d-43cc-b73c-8b9d6e8ad8dc admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.834839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79f8d-7d3d-43cc-b73c-8b9d6e8ad8dc admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:28.840757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:28.840757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:28.840757 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:28.841160 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] PATH_INFO: `/v3/projects/68a6b804f342488999e6e10a38e5d7e0/users/6244acaaa13b45da8e788e3cb5d4c04f/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:28.857062 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a6b804f342488999e6e10a38e5d7e0, user_id=6244acaaa13b45da8e788e3cb5d4c04f, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:28.860765 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:28.935167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1411/2819] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:28 2022] PUT /identity/v3/projects/68a6b804f342488999e6e10a38e5d7e0/users/6244acaaa13b45da8e788e3cb5d4c04f/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:28.940310 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca2b3e-4dd6-49bb-95cc-cede723125c2 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:28.950734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca2b3e-4dd6-49bb-95cc-cede723125c2 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:29.007804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f1368-6016-40ce-8878-bb86046d7c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:29.008425 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1368-6016-40ce-8878-bb86046d7c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:29.008707 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1368-6016-40ce-8878-bb86046d7c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:29.009049 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1368-6016-40ce-8878-bb86046d7c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:29.009741 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f1368-6016-40ce-8878-bb86046d7c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:29.011338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f1368-6016-40ce-8878-bb86046d7c4c admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:29.022623 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1409/2820] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:29.025736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:29.025736 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:29.028926 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f1368-6016-40ce-8878-bb86046d7c4c admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:29.041159 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f1368-6016-40ce-8878-bb86046d7c4c admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:29.046560 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aede324-a9f8-46d4-9fe1-e33326b8db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:29.047447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aede324-a9f8-46d4-9fe1-e33326b8db65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:29.047854 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aede324-a9f8-46d4-9fe1-e33326b8db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:29.048136 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aede324-a9f8-46d4-9fe1-e33326b8db65 admin admin] PATH_INFO: `/v3/projects/68a6b804f342488999e6e10a38e5d7e0/users/6244acaaa13b45da8e788e3cb5d4c04f/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:29.050516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aede324-a9f8-46d4-9fe1-e33326b8db65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a6b804f342488999e6e10a38e5d7e0, user_id=6244acaaa13b45da8e788e3cb5d4c04f, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:29.053758 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aede324-a9f8-46d4-9fe1-e33326b8db65 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:29.054589 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2df058-2daa-44c1-998e-84ac3aa2abb5 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:29.065681 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:29.066369 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:29.066652 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:29.066914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] PATH_INFO: `/v3/projects/84f552d4dc2c440a8ca61ecbb045d9c2` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:29.068192 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f552d4dc2c440a8ca61ecbb045d9c2)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:29.068596 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1410/2821] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:29 2022] PUT /identity/v3/projects/68a6b804f342488999e6e10a38e5d7e0/users/6244acaaa13b45da8e788e3cb5d4c04f/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:29.070741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:29.080641 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440d19-27dc-45a9-bc9c-9d73f60fb143 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:29.080952 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440d19-27dc-45a9-bc9c-9d73f60fb143 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:29.081231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440d19-27dc-45a9-bc9c-9d73f60fb143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:29.108627 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-ec440d19-27dc-45a9-bc9c-9d73f60fb143 None None] MFA Rules not processed for user `6244acaaa13b45da8e788e3cb5d4c04f`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:29.109885 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ec440d19-27dc-45a9-bc9c-9d73f60fb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:29.130861 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:29.163711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f552d4dc2c440a8ca61ecbb045d9c2', 'request_id': 'req-b4522d68-d65d-4dfe-b740-01d17fb60504'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:29.170389 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f552d4dc2c440a8ca61ecbb045d9c2', 'request_id': 'req-b4522d68-d65d-4dfe-b740-01d17fb60504'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:29.183447 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1411/2822] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:29.195360 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440d19-27dc-45a9-bc9c-9d73f60fb143 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:29.202729 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ec440d19-27dc-45a9-bc9c-9d73f60fb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:29.218785 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f552d4dc2c440a8ca61ecbb045d9c2', 'request_id': 'req-b4522d68-d65d-4dfe-b740-01d17fb60504'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:29.233552 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] The token cache is being invalidate because project 84f552d4dc2c440a8ca61ecbb045d9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:29.233825 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:29.234553 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:29.236241 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1412/2823] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:29 2022] DELETE /identity/v3/projects/84f552d4dc2c440a8ca61ecbb045d9c2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:29.263004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440d19-27dc-45a9-bc9c-9d73f60fb143 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:29.319174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:29.319721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:29.320001 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:29.320276 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:29.322174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:29.393445 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:29.394919 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:29.405116 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1412/2824] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:32:31.337156 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:31.338624 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:31.351378 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4522d68-d65d-4dfe-b740-01d17fb60504 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:31.354915 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:31.355516 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:31.355792 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:31.356064 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:31.357819 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:31.418659 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:31.420229 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:31.431813 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1413/2825] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:32.770878 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:32.779637 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504789f-b62d-4f6e-9746-28efb6269ed8 service cinder] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:32.784012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81c061-852c-4054-a6db-000eceb20d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:32.784624 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81c061-852c-4054-a6db-000eceb20d93 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:32.784920 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81c061-852c-4054-a6db-000eceb20d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:32.785220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81c061-852c-4054-a6db-000eceb20d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:32.787074 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8d81c061-852c-4054-a6db-000eceb20d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:32.814680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=100 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:32.851889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81c061-852c-4054-a6db-000eceb20d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:32.853760 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81c061-852c-4054-a6db-000eceb20d93 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:32.866083 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1413/2826] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:37.419063 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:37.420518 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:37.433864 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:37.487047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3da21-5113-41b7-b78c-e2206d6c04d8 service cinder] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:37.491597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:37.492234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:37.492517 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:37.492787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] PATH_INFO: `/v3/users/05d5d4c4cd60482e9da867ad4b7bfbe1` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:37.493987 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d5d4c4cd60482e9da867ad4b7bfbe1)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:37.495911 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:37.691561 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d5d4c4cd60482e9da867ad4b7bfbe1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:37.692131 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d5d4c4cd60482e9da867ad4b7bfbe1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:37.692839 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d5d4c4cd60482e9da867ad4b7bfbe1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:37.706602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d5d4c4cd60482e9da867ad4b7bfbe1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:37.751559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d5d4c4cd60482e9da867ad4b7bfbe1'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:37.764070 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1414/2827] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:37 2022] DELETE /identity/v3/users/05d5d4c4cd60482e9da867ad4b7bfbe1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:37.769484 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42814ea2-93b2-4d86-a0a5-dd9fb3cdf983 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:37.770011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42814ea2-93b2-4d86-a0a5-dd9fb3cdf983 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:37.770011 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42814ea2-93b2-4d86-a0a5-dd9fb3cdf983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:37.789481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-42814ea2-93b2-4d86-a0a5-dd9fb3cdf983 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:37.790683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-42814ea2-93b2-4d86-a0a5-dd9fb3cdf983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:37.848349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1414/2828] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:37.858209 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:37.859691 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:37.939547 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8126-20fc-4ba3-8e3a-a85d202409bd admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:37.943233 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786179ee-cf02-47da-960c-122f19a3c9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:37.943773 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786179ee-cf02-47da-960c-122f19a3c9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:37.944045 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786179ee-cf02-47da-960c-122f19a3c9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:37.944315 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786179ee-cf02-47da-960c-122f19a3c9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:37.953968 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786179ee-cf02-47da-960c-122f19a3c9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:37.955365 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786179ee-cf02-47da-960c-122f19a3c9c6 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:37.964707 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1415/2829] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:38.422559 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42814ea2-93b2-4d86-a0a5-dd9fb3cdf983 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:38.424062 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-42814ea2-93b2-4d86-a0a5-dd9fb3cdf983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:38.443436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42814ea2-93b2-4d86-a0a5-dd9fb3cdf983 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:38.448198 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:38.448844 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:38.449259 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:38.449471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] PATH_INFO: `/v3/projects/819c095299f44de08af80abc22cf8d53` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:38.450725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=819c095299f44de08af80abc22cf8d53)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:38.452872 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:38.582631 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819c095299f44de08af80abc22cf8d53', 'request_id': 'req-0c19caf0-5c67-4d0d-bde1-64edce0767ab'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.588303 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819c095299f44de08af80abc22cf8d53', 'request_id': 'req-0c19caf0-5c67-4d0d-bde1-64edce0767ab'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.664710 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819c095299f44de08af80abc22cf8d53', 'request_id': 'req-0c19caf0-5c67-4d0d-bde1-64edce0767ab'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.677521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] The token cache is being invalidate because project 819c095299f44de08af80abc22cf8d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:38.677812 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.678454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.679936 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1415/2830] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:38 2022] DELETE /identity/v3/projects/819c095299f44de08af80abc22cf8d53 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:38.683960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786179ee-cf02-47da-960c-122f19a3c9c6 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:38.694370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786179ee-cf02-47da-960c-122f19a3c9c6 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:38.710876 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:38.752404 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:38.753139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:38.753419 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:38.753692 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] PATH_INFO: `/v3/users/06cb3dc6e8744893adaececf922c9038` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:38.754892 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06cb3dc6e8744893adaececf922c9038)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:38.756875 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:38.913771 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06cb3dc6e8744893adaececf922c9038'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.914427 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06cb3dc6e8744893adaececf922c9038'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.915014 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06cb3dc6e8744893adaececf922c9038'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.926932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06cb3dc6e8744893adaececf922c9038'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.980103 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06cb3dc6e8744893adaececf922c9038'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:38.993614 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1416/2831] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:38 2022] DELETE /identity/v3/users/06cb3dc6e8744893adaececf922c9038 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:32:39.472053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:39.473594 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:39.488924 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19caf0-5c67-4d0d-bde1-64edce0767ab admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:39.538849 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:39.551285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:39.551930 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:39.552212 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:39.552483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] PATH_INFO: `/v3/projects/99f0f2e2e1224918a3d7ac8bc18ab62d` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:39.553673 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f0f2e2e1224918a3d7ac8bc18ab62d)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:39.555590 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:39.615760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:39.617293 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:39.677167 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e91d51-6354-4063-ba08-ed82666410d8 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:39.680744 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:39.681379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:39.681653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:39.681920 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:39.683665 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:39.694357 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:39.695762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:39.699859 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f0f2e2e1224918a3d7ac8bc18ab62d', 'request_id': 'req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:39.704571 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1417/2832] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:32:39.706134 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f0f2e2e1224918a3d7ac8bc18ab62d', 'request_id': 'req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:39.780078 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f0f2e2e1224918a3d7ac8bc18ab62d', 'request_id': 'req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:39.792573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] The token cache is being invalidate because project 99f0f2e2e1224918a3d7ac8bc18ab62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:39.792869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:39.793551 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:39.795150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1416/2833] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:39 2022] DELETE /identity/v3/projects/99f0f2e2e1224918a3d7ac8bc18ab62d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:39.802008 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:39.803410 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:39.818688 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74cecb-a8b1-4ecd-a7cd-3c22203ba54f service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:39.852894 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:39.879850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:39.880497 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:39.880788 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:39.881073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] PATH_INFO: `/v3/users/6244acaaa13b45da8e788e3cb5d4c04f` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:39.882247 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6244acaaa13b45da8e788e3cb5d4c04f)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:39.884178 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:40.079243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6244acaaa13b45da8e788e3cb5d4c04f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.079924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6244acaaa13b45da8e788e3cb5d4c04f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.080596 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6244acaaa13b45da8e788e3cb5d4c04f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.092620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6244acaaa13b45da8e788e3cb5d4c04f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.157434 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-eae56141-99ea-42f4-a3bd-8a7a7a14be4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6244acaaa13b45da8e788e3cb5d4c04f'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.170345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1418/2834] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:32:39 2022] DELETE /identity/v3/users/6244acaaa13b45da8e788e3cb5d4c04f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:40.608954 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:40.610683 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:40.623635 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eedc11-1f9e-4d00-92ee-4ea42f20d748 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:40.682040 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:40.682677 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:40.682958 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:40.683234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] PATH_INFO: `/v3/projects/68a6b804f342488999e6e10a38e5d7e0` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:40.684376 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a6b804f342488999e6e10a38e5d7e0)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:40.686432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:40.808285 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a6b804f342488999e6e10a38e5d7e0', 'request_id': 'req-bc77a990-b6c9-458a-b563-2ad0d435f4c6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.814261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a6b804f342488999e6e10a38e5d7e0', 'request_id': 'req-bc77a990-b6c9-458a-b563-2ad0d435f4c6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.888197 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a6b804f342488999e6e10a38e5d7e0', 'request_id': 'req-bc77a990-b6c9-458a-b563-2ad0d435f4c6'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.900514 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] The token cache is being invalidate because project 68a6b804f342488999e6e10a38e5d7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:32:40.900821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.901504 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-bc77a990-b6c9-458a-b563-2ad0d435f4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:32:40.903053 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1417/2835] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:32:40 2022] DELETE /identity/v3/projects/68a6b804f342488999e6e10a38e5d7e0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:40.908838 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675b31-c153-4cc6-821f-a54f198b8558 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:40.909340 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675b31-c153-4cc6-821f-a54f198b8558 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:40.909451 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675b31-c153-4cc6-821f-a54f198b8558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:40.929643 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-b2675b31-c153-4cc6-821f-a54f198b8558 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:40.930851 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-b2675b31-c153-4cc6-821f-a54f198b8558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:40.989487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1419/2836] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:40.997453 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e949-f4ca-4699-b9f8-eb4299aea647 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:40.997740 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e949-f4ca-4699-b9f8-eb4299aea647 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:40.998013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4e949-f4ca-4699-b9f8-eb4299aea647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.012253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:41.017775 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-59b4e949-f4ca-4699-b9f8-eb4299aea647 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:41.018980 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-59b4e949-f4ca-4699-b9f8-eb4299aea647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:41.027302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1418/2837] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:32:41.032149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2675b31-c153-4cc6-821f-a54f198b8558 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:41.041873 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2675b31-c153-4cc6-821f-a54f198b8558 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:41.047116 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:41.047731 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:41.051506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:41.051506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.051506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:32:41.051506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:41.051506 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:41.062962 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1420/2838] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:32:41.067397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e949-f4ca-4699-b9f8-eb4299aea647 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:41.077023 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4e949-f4ca-4699-b9f8-eb4299aea647 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:41.082189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ce5c7-0f5c-4e09-8c0d-5260a91a538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:41.085942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ce5c7-0f5c-4e09-8c0d-5260a91a538e admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:41.085942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ce5c7-0f5c-4e09-8c0d-5260a91a538e admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:41.085942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ce5c7-0f5c-4e09-8c0d-5260a91a538e admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.085942 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ce5c7-0f5c-4e09-8c0d-5260a91a538e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:41.086330 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ce5c7-0f5c-4e09-8c0d-5260a91a538e admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:41.168985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1419/2839] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:32:41 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:41.173255 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:41.183735 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31ab2-f2d0-4589-b496-1291f124255d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:41.223890 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:41.239844 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68084-e2a6-4a51-addc-d25c2f1b2a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:41.240461 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68084-e2a6-4a51-addc-d25c2f1b2a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:41.240739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68084-e2a6-4a51-addc-d25c2f1b2a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:41.241050 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68084-e2a6-4a51-addc-d25c2f1b2a39 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.241772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b68084-e2a6-4a51-addc-d25c2f1b2a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:41.243711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b68084-e2a6-4a51-addc-d25c2f1b2a39 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:41.327080 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1421/2840] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:32:41 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:32:41.331730 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ce5c7-0f5c-4e09-8c0d-5260a91a538e admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:41.342146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ce5c7-0f5c-4e09-8c0d-5260a91a538e admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:41.347604 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed472-3071-4744-9d1a-c60c6633313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:41.348213 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed472-3071-4744-9d1a-c60c6633313f admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:41.348497 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed472-3071-4744-9d1a-c60c6633313f admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:41.348774 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed472-3071-4744-9d1a-c60c6633313f admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.349509 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ed472-3071-4744-9d1a-c60c6633313f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:41.351187 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ed472-3071-4744-9d1a-c60c6633313f admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:41.361571 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1420/2841] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:41.365500 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68084-e2a6-4a51-addc-d25c2f1b2a39 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:41.375432 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68084-e2a6-4a51-addc-d25c2f1b2a39 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:41.380194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d32fdf-617a-4b38-9067-586204fe3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:41.380795 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d32fdf-617a-4b38-9067-586204fe3886 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:41.381106 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d32fdf-617a-4b38-9067-586204fe3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:41.381379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d32fdf-617a-4b38-9067-586204fe3886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.382059 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d32fdf-617a-4b38-9067-586204fe3886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:41.383637 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d32fdf-617a-4b38-9067-586204fe3886 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:41.395817 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1422/2842] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:32:41.399968 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed472-3071-4744-9d1a-c60c6633313f admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:41.410963 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed472-3071-4744-9d1a-c60c6633313f admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:41.415558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:41.416210 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:41.416489 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:41.416765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] PATH_INFO: `/v3/projects/7003b3684b2c4e32a642eb7a9d249647/users/9761df2c6be1444e865e35d9b66ba85c/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.433046 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7003b3684b2c4e32a642eb7a9d249647, user_id=9761df2c6be1444e865e35d9b66ba85c, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:41.435734 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:41.529736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1421/2843] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:32:41 2022] PUT /identity/v3/projects/7003b3684b2c4e32a642eb7a9d249647/users/9761df2c6be1444e865e35d9b66ba85c/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:32:41.598170 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46f11-bd33-49bf-ad0a-ea7ae88f24b4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:41.598454 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46f11-bd33-49bf-ad0a-ea7ae88f24b4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:41.598728 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f46f11-bd33-49bf-ad0a-ea7ae88f24b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.627222 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e3f46f11-bd33-49bf-ad0a-ea7ae88f24b4 None None] MFA Rules not processed for user `9761df2c6be1444e865e35d9b66ba85c`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:32:41.628425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e3f46f11-bd33-49bf-ad0a-ea7ae88f24b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:41.694509 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1423/2844] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:32:41.705338 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:41.707381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:41.766995 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96cb3a-24ac-4571-ab08-b5d1b976d656 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:41.770959 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad56212b530461cb19f1bb2b4b14027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:41.771573 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:41.771855 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:41.772130 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:41.780522 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:41.782665 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:41.791857 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1422/2845] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:45.874827 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f46f11-bd33-49bf-ad0a-ea7ae88f24b4 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:45.876345 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e3f46f11-bd33-49bf-ad0a-ea7ae88f24b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:45.983679 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f46f11-bd33-49bf-ad0a-ea7ae88f24b4 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:45.989145 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:45.989930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:45.990204 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:45.990485 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:45.992322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:46.004830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:46.006449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:46.016527 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1424/2846] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:32:51.787889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:56.012193 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:32:56.819220 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:32:56.821229 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:56.880565 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818c5a5-b41f-44c9-8407-f3206b921b61 service glance] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:32:56.884202 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a069-e011-4279-8932-2c9c701f8322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:32:56.884807 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a069-e011-4279-8932-2c9c701f8322 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:32:56.885115 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a069-e011-4279-8932-2c9c701f8322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:32:56.885381 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a069-e011-4279-8932-2c9c701f8322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:32:56.887089 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-8fd5a069-e011-4279-8932-2c9c701f8322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:32:56.952436 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5a069-e011-4279-8932-2c9c701f8322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:32:56.953914 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5a069-e011-4279-8932-2c9c701f8322 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:32:56.964077 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1423/2847] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:32:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:33:06.020662 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:06.076425 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271ff5-a34c-4803-ad40-ce339b796a57 service placement] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:06.081077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:06.081710 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:06.082019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:06.082288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] PATH_INFO: `/v3/users/9761df2c6be1444e865e35d9b66ba85c` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:06.083449 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9761df2c6be1444e865e35d9b66ba85c)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:06.085447 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:06.278896 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9761df2c6be1444e865e35d9b66ba85c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:06.279661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9761df2c6be1444e865e35d9b66ba85c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:06.280267 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9761df2c6be1444e865e35d9b66ba85c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:06.292197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9761df2c6be1444e865e35d9b66ba85c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:06.366756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9761df2c6be1444e865e35d9b66ba85c'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:06.380058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1425/2848] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:33:06 2022] DELETE /identity/v3/users/9761df2c6be1444e865e35d9b66ba85c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:33:06.384796 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbac8e-e4c2-4f81-aa63-890313fca62d None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:06.385317 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbac8e-e4c2-4f81-aa63-890313fca62d None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:06.385431 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbac8e-e4c2-4f81-aa63-890313fca62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:06.404444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-75bbac8e-e4c2-4f81-aa63-890313fca62d None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:06.405682 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-75bbac8e-e4c2-4f81-aa63-890313fca62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:06.463684 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1424/2849] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:06.484657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:06.484657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:06.537629 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e40a6-a26b-4e6e-b0b1-254280e66777 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:06.541159 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd0157-b7ae-4319-b8ed-749d04d40448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:06.541762 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd0157-b7ae-4319-b8ed-749d04d40448 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:06.542034 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd0157-b7ae-4319-b8ed-749d04d40448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:06.542299 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd0157-b7ae-4319-b8ed-749d04d40448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:06.551992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd0157-b7ae-4319-b8ed-749d04d40448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:06.553437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd0157-b7ae-4319-b8ed-749d04d40448 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:06.562850 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1426/2850] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:33:07.519234 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbac8e-e4c2-4f81-aa63-890313fca62d None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:07.521113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-75bbac8e-e4c2-4f81-aa63-890313fca62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:07.533527 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbac8e-e4c2-4f81-aa63-890313fca62d None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:07.547915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:07.547915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:07.547915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:07.547915 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] PATH_INFO: `/v3/projects/7003b3684b2c4e32a642eb7a9d249647` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:07.548747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7003b3684b2c4e32a642eb7a9d249647)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:07.548747 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:07.664346 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:07.667164 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7003b3684b2c4e32a642eb7a9d249647', 'request_id': 'req-82e05d9e-d65d-48f2-8114-c2cd7833cc34'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:07.672505 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7003b3684b2c4e32a642eb7a9d249647', 'request_id': 'req-82e05d9e-d65d-48f2-8114-c2cd7833cc34'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:07.728512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7003b3684b2c4e32a642eb7a9d249647', 'request_id': 'req-82e05d9e-d65d-48f2-8114-c2cd7833cc34'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:07.741223 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] The token cache is being invalidate because project 7003b3684b2c4e32a642eb7a9d249647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:33:07.741512 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:07.742146 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-82e05d9e-d65d-48f2-8114-c2cd7833cc34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:07.743654 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1425/2851] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:33:07 2022] DELETE /identity/v3/projects/7003b3684b2c4e32a642eb7a9d249647 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:33:07.748737 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3c907-9167-41cd-8431-f717aa89cdfd None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:07.749304 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3c907-9167-41cd-8431-f717aa89cdfd None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:07.749534 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3c907-9167-41cd-8431-f717aa89cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:07.770537 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-cdf3c907-9167-41cd-8431-f717aa89cdfd None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:07.771733 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cdf3c907-9167-41cd-8431-f717aa89cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:07.789529 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:07.830463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1427/2852] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:07.839098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4cff7-a148-4296-9259-7c5ce3decfff None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:07.839389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4cff7-a148-4296-9259-7c5ce3decfff None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:07.839662 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4cff7-a148-4296-9259-7c5ce3decfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:07.861751 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-dce4cff7-a148-4296-9259-7c5ce3decfff None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:07.863125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-dce4cff7-a148-4296-9259-7c5ce3decfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:07.871493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1426/2853] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:07.875724 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3c907-9167-41cd-8431-f717aa89cdfd None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:07.886012 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3c907-9167-41cd-8431-f717aa89cdfd None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:07.890709 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:07.891326 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:07.891601 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:07.891868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:07.892651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:33:07.892980 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:07.895560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:07.907868 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1428/2854] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:33:07.913255 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4cff7-a148-4296-9259-7c5ce3decfff None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:07.923118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4cff7-a148-4296-9259-7c5ce3decfff None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:07.928035 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6734-6e45-451a-b396-4fedb5ca80fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:07.928695 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6734-6e45-451a-b396-4fedb5ca80fc admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:07.929012 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6734-6e45-451a-b396-4fedb5ca80fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:07.929309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6734-6e45-451a-b396-4fedb5ca80fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:07.929988 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff6734-6e45-451a-b396-4fedb5ca80fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:07.931907 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff6734-6e45-451a-b396-4fedb5ca80fc admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:08.021363 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1427/2855] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:33:07 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:33:08.025966 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:08.037347 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc69123-7898-4a6d-abba-b8aa52f6f93d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:08.095822 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ebcdd-cea4-404d-9a80-175a2cdf1c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:08.096438 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebcdd-cea4-404d-9a80-175a2cdf1c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:08.096718 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebcdd-cea4-404d-9a80-175a2cdf1c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:08.097025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebcdd-cea4-404d-9a80-175a2cdf1c3c admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:08.098379 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ebcdd-cea4-404d-9a80-175a2cdf1c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:08.100308 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ebcdd-cea4-404d-9a80-175a2cdf1c3c admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:08.163237 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1429/2856] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:33:08 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:33:08.167493 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6734-6e45-451a-b396-4fedb5ca80fc admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:08.178095 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6734-6e45-451a-b396-4fedb5ca80fc admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:08.182608 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e98bf-1a0b-4052-8f7c-40c234aee882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:08.183216 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e98bf-1a0b-4052-8f7c-40c234aee882 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:08.183500 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e98bf-1a0b-4052-8f7c-40c234aee882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:08.183780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e98bf-1a0b-4052-8f7c-40c234aee882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:08.184475 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e98bf-1a0b-4052-8f7c-40c234aee882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:08.186108 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e98bf-1a0b-4052-8f7c-40c234aee882 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:08.196343 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1428/2857] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:33:08.200453 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ebcdd-cea4-404d-9a80-175a2cdf1c3c admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:08.211442 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ebcdd-cea4-404d-9a80-175a2cdf1c3c admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:08.216136 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e317b-ff4e-4c67-872f-4ae6f63cface admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:08.216742 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e317b-ff4e-4c67-872f-4ae6f63cface admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:08.217061 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e317b-ff4e-4c67-872f-4ae6f63cface admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:08.217334 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e317b-ff4e-4c67-872f-4ae6f63cface admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:08.218025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e317b-ff4e-4c67-872f-4ae6f63cface admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:08.219620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e317b-ff4e-4c67-872f-4ae6f63cface admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:08.230719 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1430/2858] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:33:08.234978 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e98bf-1a0b-4052-8f7c-40c234aee882 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:08.245050 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e98bf-1a0b-4052-8f7c-40c234aee882 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:08.249780 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:08.250433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:08.250713 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:08.250985 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] PATH_INFO: `/v3/projects/21a0af7298e04dce8a3f9f751a59da1b/users/5d26f1d9e2af4fc599c841cbba76355d/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:08.266139 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a0af7298e04dce8a3f9f751a59da1b, user_id=5d26f1d9e2af4fc599c841cbba76355d, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:08.268785 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:08.350069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1429/2859] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:33:08 2022] PUT /identity/v3/projects/21a0af7298e04dce8a3f9f751a59da1b/users/5d26f1d9e2af4fc599c841cbba76355d/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:33:08.366723 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d6a89-aff4-4e6d-b543-1a298547fb78 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:08.367009 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d6a89-aff4-4e6d-b543-1a298547fb78 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:08.367286 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d6a89-aff4-4e6d-b543-1a298547fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:08.397280 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-358d6a89-aff4-4e6d-b543-1a298547fb78 None None] MFA Rules not processed for user `5d26f1d9e2af4fc599c841cbba76355d`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:08.398578 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-358d6a89-aff4-4e6d-b543-1a298547fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:08.462955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1431/2860] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:08.473554 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:08.475309 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:08.569787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fa419-15c7-4525-981c-16fa13ec60b8 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:08.573526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e346854-c9cb-4d32-85a7-f0c9f58af0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3771fe71ef624fd38dcaf2bff3751663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:08.574144 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346854-c9cb-4d32-85a7-f0c9f58af0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:08.574423 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346854-c9cb-4d32-85a7-f0c9f58af0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:08.574696 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346854-c9cb-4d32-85a7-f0c9f58af0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:08.583456 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e346854-c9cb-4d32-85a7-f0c9f58af0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:08.584908 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e346854-c9cb-4d32-85a7-f0c9f58af0c1 service cinder] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:08.593922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1430/2861] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:33:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:33:18.460055 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:18.589879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=4,keystone:SELECT=69,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:19.968704 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d6a89-aff4-4e6d-b543-1a298547fb78 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:20.036845 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d6a89-aff4-4e6d-b543-1a298547fb78 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:20.041407 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:20.042044 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:20.042322 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:20.042593 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] PATH_INFO: `/v3/users/5d26f1d9e2af4fc599c841cbba76355d` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:20.043760 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d26f1d9e2af4fc599c841cbba76355d)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:20.045705 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:20.250263 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d26f1d9e2af4fc599c841cbba76355d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:20.250862 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d26f1d9e2af4fc599c841cbba76355d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:20.251487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d26f1d9e2af4fc599c841cbba76355d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:20.263756 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d26f1d9e2af4fc599c841cbba76355d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:20.339693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d26f1d9e2af4fc599c841cbba76355d'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:20.354097 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1432/2862] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:33:19 2022] DELETE /identity/v3/users/5d26f1d9e2af4fc599c841cbba76355d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:33:20.358961 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d6e4d-9f45-4c9b-8e86-edf2319b0f40 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:20.359658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d6e4d-9f45-4c9b-8e86-edf2319b0f40 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:20.359658 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d6e4d-9f45-4c9b-8e86-edf2319b0f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:20.379481 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-df7d6e4d-9f45-4c9b-8e86-edf2319b0f40 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:20.383821 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-df7d6e4d-9f45-4c9b-8e86-edf2319b0f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:20.442025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1431/2863] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:20.451961 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:20.453411 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:20.513072 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185014d8-01ae-41d3-b641-9380a24b6e1d admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:20.516702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92846fe-f7f5-4afd-8e07-5df4e581343a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:20.517359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92846fe-f7f5-4afd-8e07-5df4e581343a service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:20.517635 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92846fe-f7f5-4afd-8e07-5df4e581343a service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:20.517906 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92846fe-f7f5-4afd-8e07-5df4e581343a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:20.529024 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92846fe-f7f5-4afd-8e07-5df4e581343a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:20.530467 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92846fe-f7f5-4afd-8e07-5df4e581343a service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:20.541067 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1433/2864] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:33:20.930928 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d6e4d-9f45-4c9b-8e86-edf2319b0f40 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:20.932479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-df7d6e4d-9f45-4c9b-8e86-edf2319b0f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:20.951357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d6e4d-9f45-4c9b-8e86-edf2319b0f40 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:20.960044 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:20.961110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:20.961613 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:20.961999 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] PATH_INFO: `/v3/projects/21a0af7298e04dce8a3f9f751a59da1b` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:20.963446 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a0af7298e04dce8a3f9f751a59da1b)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:20.965877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:21.082401 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a0af7298e04dce8a3f9f751a59da1b', 'request_id': 'req-88a1426d-4061-460a-b572-43591f6594b8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:21.088261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a0af7298e04dce8a3f9f751a59da1b', 'request_id': 'req-88a1426d-4061-460a-b572-43591f6594b8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:21.156708 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a0af7298e04dce8a3f9f751a59da1b', 'request_id': 'req-88a1426d-4061-460a-b572-43591f6594b8'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:21.169882 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] The token cache is being invalidate because project 21a0af7298e04dce8a3f9f751a59da1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80841) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:33:21.170169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:21.170804 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-88a1426d-4061-460a-b572-43591f6594b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:33:21.172455 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1432/2865] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:33:20 2022] DELETE /identity/v3/projects/21a0af7298e04dce8a3f9f751a59da1b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:33:21.178384 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd79d1-1c91-49a3-b5c3-52aacb2b3bd2 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.178870 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd79d1-1c91-49a3-b5c3-52aacb2b3bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.179027 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd79d1-1c91-49a3-b5c3-52aacb2b3bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.200901 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-01fd79d1-1c91-49a3-b5c3-52aacb2b3bd2 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:21.202288 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-01fd79d1-1c91-49a3-b5c3-52aacb2b3bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:21.221632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:21.273994 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1434/2866] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:21.301630 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50858c8a-c4c6-4891-ae76-ff0fd7de1be9 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.301913 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50858c8a-c4c6-4891-ae76-ff0fd7de1be9 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.302188 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50858c8a-c4c6-4891-ae76-ff0fd7de1be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.322601 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-50858c8a-c4c6-4891-ae76-ff0fd7de1be9 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:21.323806 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-50858c8a-c4c6-4891-ae76-ff0fd7de1be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:21.332671 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1433/2867] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:21.337058 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd79d1-1c91-49a3-b5c3-52aacb2b3bd2 None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:21.347914 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd79d1-1c91-49a3-b5c3-52aacb2b3bd2 None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:21.352702 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:21.353695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.353695 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.353978 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] PATH_INFO: `/v3/domains` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.354545 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80840) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:33:21.354843 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:21.356429 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:21.368611 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1435/2868] 10.222.0.93 () {58 vars in 1153 bytes} [Thu Aug 4 21:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:33:21.373106 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50858c8a-c4c6-4891-ae76-ff0fd7de1be9 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:21.382615 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50858c8a-c4c6-4891-ae76-ff0fd7de1be9 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:21.387373 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb185b2-c4fa-4340-95f5-08caf892e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:21.387989 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb185b2-c4fa-4340-95f5-08caf892e7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.388267 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb185b2-c4fa-4340-95f5-08caf892e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.388542 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb185b2-c4fa-4340-95f5-08caf892e7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.389327 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb185b2-c4fa-4340-95f5-08caf892e7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:21.391204 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb185b2-c4fa-4340-95f5-08caf892e7c9 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:21.479646 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1434/2869] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:33:21 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:33:21.483955 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:21.494551 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0d6fa-2927-48ad-8173-293025934262 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:21.556297 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2532f-c755-4385-9022-454cfb7aa4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:21.556954 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2532f-c755-4385-9022-454cfb7aa4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.557234 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2532f-c755-4385-9022-454cfb7aa4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.557502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2532f-c755-4385-9022-454cfb7aa4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.558171 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2532f-c755-4385-9022-454cfb7aa4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:21.560135 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2532f-c755-4385-9022-454cfb7aa4c3 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:21.671636 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1436/2870] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:33:21 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:33:21.676629 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb185b2-c4fa-4340-95f5-08caf892e7c9 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:21.687017 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb185b2-c4fa-4340-95f5-08caf892e7c9 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:21.692389 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f72e0-d002-40ad-8fe5-cd4f868dcbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:21.693025 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f72e0-d002-40ad-8fe5-cd4f868dcbab admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.693609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f72e0-d002-40ad-8fe5-cd4f868dcbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.693609 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f72e0-d002-40ad-8fe5-cd4f868dcbab admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.694365 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f72e0-d002-40ad-8fe5-cd4f868dcbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:21.695847 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f72e0-d002-40ad-8fe5-cd4f868dcbab admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:21.705931 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1435/2871] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:33:21.710682 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2532f-c755-4385-9022-454cfb7aa4c3 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:21.720812 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2532f-c755-4385-9022-454cfb7aa4c3 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:21.725741 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c25159-6b08-4998-8eef-d2adf96847bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:21.726343 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25159-6b08-4998-8eef-d2adf96847bb admin admin] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.726620 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25159-6b08-4998-8eef-d2adf96847bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.726889 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c25159-6b08-4998-8eef-d2adf96847bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.727602 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c25159-6b08-4998-8eef-d2adf96847bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:21.729269 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c25159-6b08-4998-8eef-d2adf96847bb admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:21.740197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1437/2872] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:33:21.744434 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f72e0-d002-40ad-8fe5-cd4f868dcbab admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:21.755716 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f72e0-d002-40ad-8fe5-cd4f868dcbab admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:21.760461 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:21.761163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.761441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.761712 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] PATH_INFO: `/v3/projects/ae4600d4b15445b5948df13c9c4d6769/users/bdc4c0bef23a4491950cdf66715d778e/roles/59c9db9bdfff4dddb561f03e052100d2` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.778119 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4600d4b15445b5948df13c9c4d6769, user_id=bdc4c0bef23a4491950cdf66715d778e, role_id=59c9db9bdfff4dddb561f03e052100d2)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:21.780793 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:21.854432 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1436/2873] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:33:21 2022] PUT /identity/v3/projects/ae4600d4b15445b5948df13c9c4d6769/users/bdc4c0bef23a4491950cdf66715d778e/roles/59c9db9bdfff4dddb561f03e052100d2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:33:21.859653 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db9e04-a3af-46a2-8b74-e71e0017bdb4 None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:21.859939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db9e04-a3af-46a2-8b74-e71e0017bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:21.860218 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db9e04-a3af-46a2-8b74-e71e0017bdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:21.882382 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-e5db9e04-a3af-46a2-8b74-e71e0017bdb4 None None] MFA Rules not processed for user `0b3130018efa44a5a2048fca15b5c1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:21.885921 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-e5db9e04-a3af-46a2-8b74-e71e0017bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:21.945069 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1438/2874] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:21.955006 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:21.957552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:21.981721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:22.021881 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53651d2f-04cd-419d-953d-ae5bc265f622 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:22.025748 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9bbac-2107-481f-b0ca-a72bc4b37e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:22.028334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9bbac-2107-481f-b0ca-a72bc4b37e68 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:22.028334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9bbac-2107-481f-b0ca-a72bc4b37e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:22.028334 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9bbac-2107-481f-b0ca-a72bc4b37e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:22.037003 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9bbac-2107-481f-b0ca-a72bc4b37e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:22.038451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9bbac-2107-481f-b0ca-a72bc4b37e68 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:22.049357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1437/2875] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:33:27.358513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bee5f-3109-44ea-9651-370904f3b42b None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:27.358513 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bee5f-3109-44ea-9651-370904f3b42b None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:27.359166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bee5f-3109-44ea-9651-370904f3b42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:27.390879 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-455bee5f-3109-44ea-9651-370904f3b42b None None] MFA Rules not processed for user `bdc4c0bef23a4491950cdf66715d778e`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:27.392294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-455bee5f-3109-44ea-9651-370904f3b42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:27.414416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:27.471669 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1439/2876] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:27.477228 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9bbac-2107-481f-b0ca-a72bc4b37e68 service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:27.487603 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9bbac-2107-481f-b0ca-a72bc4b37e68 service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:27.498437 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b31b3-c417-4332-8f2f-dd548237dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:27.499094 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b31b3-c417-4332-8f2f-dd548237dba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:27.499372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b31b3-c417-4332-8f2f-dd548237dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:27.499630 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b31b3-c417-4332-8f2f-dd548237dba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:27.501013 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b31b3-c417-4332-8f2f-dd548237dba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:27.502768 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b31b3-c417-4332-8f2f-dd548237dba9 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:27.592372 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1438/2877] 10.222.0.93 () {60 vars in 1153 bytes} [Thu Aug 4 21:33:27 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:33:27.596603 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bee5f-3109-44ea-9651-370904f3b42b None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:27.608715 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bee5f-3109-44ea-9651-370904f3b42b None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:27.668068 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c6724-a24e-4931-a2f5-c51f02c7d617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:27.668686 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6724-a24e-4931-a2f5-c51f02c7d617 admin admin] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:27.668991 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6724-a24e-4931-a2f5-c51f02c7d617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:27.669337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c6724-a24e-4931-a2f5-c51f02c7d617 admin admin] PATH_INFO: `/v3/users` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:27.670025 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c6724-a24e-4931-a2f5-c51f02c7d617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:27.671948 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c6724-a24e-4931-a2f5-c51f02c7d617 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:27.797350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1440/2878] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Aug 4 21:33:27 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:33:27.801827 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b31b3-c417-4332-8f2f-dd548237dba9 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:27.813397 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b31b3-c417-4332-8f2f-dd548237dba9 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:27.819060 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb607f4d-8608-4b4f-9f4e-6ab5d7657511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:27.819693 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb607f4d-8608-4b4f-9f4e-6ab5d7657511 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:27.819977 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb607f4d-8608-4b4f-9f4e-6ab5d7657511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:27.820252 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb607f4d-8608-4b4f-9f4e-6ab5d7657511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:27.820993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb607f4d-8608-4b4f-9f4e-6ab5d7657511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:27.822640 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb607f4d-8608-4b4f-9f4e-6ab5d7657511 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:27.835416 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1439/2879] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:33:27.840824 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c6724-a24e-4931-a2f5-c51f02c7d617 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:27.852166 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c6724-a24e-4931-a2f5-c51f02c7d617 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:27.856959 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc23ed6-9328-4130-a4a3-7c590ce2459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:27.857644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23ed6-9328-4130-a4a3-7c590ce2459b admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:27.857918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23ed6-9328-4130-a4a3-7c590ce2459b admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:27.858191 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc23ed6-9328-4130-a4a3-7c590ce2459b admin admin] PATH_INFO: `/v3/projects/a53a5bc2bec94bd6b492db515fd0c331/users/30373d71948d4326af88e6f93ff4d3c7/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:27.875344 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc23ed6-9328-4130-a4a3-7c590ce2459b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53a5bc2bec94bd6b492db515fd0c331, user_id=30373d71948d4326af88e6f93ff4d3c7, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:27.879048 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc23ed6-9328-4130-a4a3-7c590ce2459b admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:28.020323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1441/2880] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:33:27 2022] PUT /identity/v3/projects/a53a5bc2bec94bd6b492db515fd0c331/users/30373d71948d4326af88e6f93ff4d3c7/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:33:28.024272 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb607f4d-8608-4b4f-9f4e-6ab5d7657511 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:28.034811 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb607f4d-8608-4b4f-9f4e-6ab5d7657511 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:28.096137 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85690e9-a59e-4eb6-a61b-20b9f5f3d1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:28.096825 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85690e9-a59e-4eb6-a61b-20b9f5f3d1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:28.097895 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85690e9-a59e-4eb6-a61b-20b9f5f3d1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:28.098476 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85690e9-a59e-4eb6-a61b-20b9f5f3d1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:28.099408 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85690e9-a59e-4eb6-a61b-20b9f5f3d1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:28.101181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85690e9-a59e-4eb6-a61b-20b9f5f3d1e1 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:28.113111 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1440/2881] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 21:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:33:28.117673 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc23ed6-9328-4130-a4a3-7c590ce2459b admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:28.129387 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc23ed6-9328-4130-a4a3-7c590ce2459b admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:28.134368 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:28.135163 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:28.135444 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:28.135717 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] PATH_INFO: `/v3/projects/a53a5bc2bec94bd6b492db515fd0c331/users/30373d71948d4326af88e6f93ff4d3c7/roles/1ace4f50ff3d45f39658ba8804c18f16` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:28.137939 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53a5bc2bec94bd6b492db515fd0c331, user_id=30373d71948d4326af88e6f93ff4d3c7, role_id=1ace4f50ff3d45f39658ba8804c18f16)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:28.140583 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:28.152836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1442/2882] 10.222.0.93 () {60 vars in 1483 bytes} [Thu Aug 4 21:33:28 2022] PUT /identity/v3/projects/a53a5bc2bec94bd6b492db515fd0c331/users/30373d71948d4326af88e6f93ff4d3c7/roles/1ace4f50ff3d45f39658ba8804c18f16 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:33:33.895569 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8482-2b57-4dc3-9733-b7c6aa7457f3 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:33.896113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8482-2b57-4dc3-9733-b7c6aa7457f3 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:33.896113 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8482-2b57-4dc3-9733-b7c6aa7457f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:33.927569 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-d63c8482-2b57-4dc3-9733-b7c6aa7457f3 None None] MFA Rules not processed for user `30373d71948d4326af88e6f93ff4d3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:33.929765 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-d63c8482-2b57-4dc3-9733-b7c6aa7457f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:34.004395 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1441/2883] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:34.017582 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:34.020437 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:34.085630 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3c003-94f2-485e-be45-bdb418a248a4 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:34.089158 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad56212b530461cb19f1bb2b4b14027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:34.089769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:34.090047 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:34.090324 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:34.115666 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:34.148051 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:34.149559 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:34.160194 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1443/2884] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:33:34.390568 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94f754-6bcd-4c36-b074-b7ecff932467 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:34.390852 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94f754-6bcd-4c36-b074-b7ecff932467 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:34.391126 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94f754-6bcd-4c36-b074-b7ecff932467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:34.411622 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:34.425207 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-7b94f754-6bcd-4c36-b074-b7ecff932467 None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:34.426871 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7b94f754-6bcd-4c36-b074-b7ecff932467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:34.490378 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1442/2885] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:33:34.617891 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:34.619305 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:34.695294 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32f370-58b0-49cd-83c0-930bf9805a18 service glance] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:34.700219 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9574f-4a98-4d57-b868-3fe43b0cd224 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:34.700836 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9574f-4a98-4d57-b868-3fe43b0cd224 service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:34.701147 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9574f-4a98-4d57-b868-3fe43b0cd224 service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:34.701416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9574f-4a98-4d57-b868-3fe43b0cd224 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:34.710560 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9574f-4a98-4d57-b868-3fe43b0cd224 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:34.712139 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9574f-4a98-4d57-b868-3fe43b0cd224 service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:34.721701 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1444/2886] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:33:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:33:44.452125 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a787f-583a-4f7c-b786-c76b4251a8f6 None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:44.452786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a787f-583a-4f7c-b786-c76b4251a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:44.452786 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a787f-583a-4f7c-b786-c76b4251a8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:44.472280 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-cb5a787f-583a-4f7c-b786-c76b4251a8f6 None None] MFA Rules not processed for user `bdc4c0bef23a4491950cdf66715d778e`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:44.473558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-cb5a787f-583a-4f7c-b786-c76b4251a8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:44.480544 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1443/2887] 10.222.0.93 () {58 vars in 958 bytes} [Thu Aug 4 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:44.717359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=48 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:33:51.982128 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23088-07c9-4999-9dbc-7c0e9a9809ca None None] REQUEST_METHOD: `POST` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:51.982918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23088-07c9-4999-9dbc-7c0e9a9809ca None None] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:51.982918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23088-07c9-4999-9dbc-7c0e9a9809ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:52.032536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.auth.core [None req-6fa23088-07c9-4999-9dbc-7c0e9a9809ca None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80840) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:33:52.032536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6fa23088-07c9-4999-9dbc-7c0e9a9809ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:33:52.032536 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1445/2888] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Aug 4 21:33:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:33:52.034698 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a787f-583a-4f7c-b786-c76b4251a8f6 None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:33:52.041569 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a787f-583a-4f7c-b786-c76b4251a8f6 None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:33:52.046956 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e050ff-9698-4728-a804-3c8e3a7d8644 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:33:52.047840 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e050ff-9698-4728-a804-3c8e3a7d8644 service swift] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:33:52.048181 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e050ff-9698-4728-a804-3c8e3a7d8644 service swift] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:33:52.048584 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e050ff-9698-4728-a804-3c8e3a7d8644 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:33:52.059868 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e050ff-9698-4728-a804-3c8e3a7d8644 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:33:52.061787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e050ff-9698-4728-a804-3c8e3a7d8644 service swift] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:33:52.072368 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1444/2889] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:33:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:34:01.997696 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=3 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:02.067653 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=33 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:15.421932 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa23088-07c9-4999-9dbc-7c0e9a9809ca None None] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:34:15.423861 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-6fa23088-07c9-4999-9dbc-7c0e9a9809ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:34:15.479380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa23088-07c9-4999-9dbc-7c0e9a9809ca None None] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:34:15.482924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655bc1c-1fc5-468f-a11f-2e96df98b197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:34:15.483532 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655bc1c-1fc5-468f-a11f-2e96df98b197 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:34:15.483807 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655bc1c-1fc5-468f-a11f-2e96df98b197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:34:15.484076 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655bc1c-1fc5-468f-a11f-2e96df98b197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:34:15.493992 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655bc1c-1fc5-468f-a11f-2e96df98b197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:34:15.495416 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655bc1c-1fc5-468f-a11f-2e96df98b197 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:34:15.505871 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1446/2890] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:34:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:25.500772 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=26 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:46.480526 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e050ff-9698-4728-a804-3c8e3a7d8644 service swift] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:34:46.490752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e050ff-9698-4728-a804-3c8e3a7d8644 service swift] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:34:46.495320 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:34:46.495933 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:34:46.496215 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:34:46.496521 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:34:46.498451 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:34:46.610110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:34:46.611552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:34:46.624636 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1445/2891] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:34:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:48.006049 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655bc1c-1fc5-468f-a11f-2e96df98b197 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:34:48.015208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655bc1c-1fc5-468f-a11f-2e96df98b197 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:34:48.019546 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:34:48.020153 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:34:48.020563 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:34:48.020711 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:34:48.022739 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:34:48.038350 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:34:48.039964 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:34:48.052149 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1447/2892] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:34:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:34:56.618678 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=34 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:34:58.046243 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=6 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:07.230946 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:07.239701 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5015d-3e38-4705-b204-2f3ddf291e8e service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:07.243321 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:07.243922 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:07.244191 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:07.244454 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:07.246243 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:35:07.255725 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:07.257163 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:07.266069 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1446/2893] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:35:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:35:11.826273 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:11.837520 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61671c66-487e-4833-86f8-439ebd06cbb3 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:11.850878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:11.850878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:11.850878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:11.850878 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:11.851341 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:35:11.855541 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:11.857105 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:11.865610 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1448/2894] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:35:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:35:11.942599 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:11.951773 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dd8a9-5bb8-49a7-b7d2-ac95482a4bde service neutron] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:11.956815 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c6841-1166-45b0-8133-6686c04f0229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67b35a2567941f59dd746a3813b9d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:11.957457 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c6841-1166-45b0-8133-6686c04f0229 service neutron] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:11.957736 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c6841-1166-45b0-8133-6686c04f0229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:11.958004 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c6841-1166-45b0-8133-6686c04f0229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:11.959820 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-0c5c6841-1166-45b0-8133-6686c04f0229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:35:11.974357 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c6841-1166-45b0-8133-6686c04f0229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:11.976607 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c6841-1166-45b0-8133-6686c04f0229 service neutron] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:11.987752 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1447/2895] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:35:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:35:21.861680 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=6 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:21.982700 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=12 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:34.179854 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:34.181391 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:35:34.199974 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc3929-6a39-4e54-9d61-6d7d6a4b8304 service neutron] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:34.209644 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:34.211814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:34.211814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:34.211814 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:34.212585 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:35:34.229466 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:34.238107 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:34.246013 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1449/2896] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:35:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:35:42.636429 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d3ec9-dab7-4f6e-91ea-872b14800b1c None None] REQUEST_METHOD: `POST` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:42.636991 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d3ec9-dab7-4f6e-91ea-872b14800b1c None None] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:42.637140 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d3ec9-dab7-4f6e-91ea-872b14800b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:42.686566 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.auth.core [None req-a81d3ec9-dab7-4f6e-91ea-872b14800b1c None None] MFA Rules not processed for user `f412bc92d203449fb04f3d2c1194f937`. Rule list: `[]` (Enabled: `True`). {{(pid=80841) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:35:42.687788 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-a81d3ec9-dab7-4f6e-91ea-872b14800b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:35:42.705667 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1448/2897] 10.222.0.93 () {58 vars in 967 bytes} [Thu Aug 4 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:35:42.745657 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:42.767073 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c3dd6-542d-40a6-9342-b1f85484c039 service nova] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:42.773010 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2f4b-b619-4606-81b7-6ffc8ce8819c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '348efd4e6a0948afb8b0015d9bfb1d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:42.773632 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2f4b-b619-4606-81b7-6ffc8ce8819c service swift] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:42.773930 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2f4b-b619-4606-81b7-6ffc8ce8819c service swift] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:42.774198 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2f4b-b619-4606-81b7-6ffc8ce8819c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:42.782502 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb2f4b-b619-4606-81b7-6ffc8ce8819c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:42.784054 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb2f4b-b619-4606-81b7-6ffc8ce8819c service swift] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:42.792397 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1450/2898] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Aug 4 21:35:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:35:50.778879 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d3ec9-dab7-4f6e-91ea-872b14800b1c None None] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:50.852232 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d3ec9-dab7-4f6e-91ea-872b14800b1c None None] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:50.854696 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:50.855329 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:50.855606 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:50.855877 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] PATH_INFO: `/v3/users/bdc4c0bef23a4491950cdf66715d778e` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:50.857158 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc4c0bef23a4491950cdf66715d778e)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:50.859178 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:51.022261 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc4c0bef23a4491950cdf66715d778e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.030353 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc4c0bef23a4491950cdf66715d778e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.092297 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc4c0bef23a4491950cdf66715d778e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.106491 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc4c0bef23a4491950cdf66715d778e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.107110 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc4c0bef23a4491950cdf66715d778e'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.113150 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1449/2899] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:35:50 2022] DELETE /identity/v3/users/bdc4c0bef23a4491950cdf66715d778e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:35:51.356490 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2f4b-b619-4606-81b7-6ffc8ce8819c service swift] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:51.367671 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2f4b-b619-4606-81b7-6ffc8ce8819c service swift] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:51.426019 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:51.426648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:51.426924 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:51.427189 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] PATH_INFO: `/v3/projects/ae4600d4b15445b5948df13c9c4d6769` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:51.428436 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4600d4b15445b5948df13c9c4d6769)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:51.430380 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:51.549958 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4600d4b15445b5948df13c9c4d6769', 'request_id': 'req-be13b9bd-09f0-4859-a83a-06fd834ad99e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.555598 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4600d4b15445b5948df13c9c4d6769', 'request_id': 'req-be13b9bd-09f0-4859-a83a-06fd834ad99e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.623323 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4600d4b15445b5948df13c9c4d6769', 'request_id': 'req-be13b9bd-09f0-4859-a83a-06fd834ad99e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.635769 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] The token cache is being invalidate because project ae4600d4b15445b5948df13c9c4d6769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:35:51.636114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.636722 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.638276 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1451/2900] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:35:51 2022] DELETE /identity/v3/projects/ae4600d4b15445b5948df13c9c4d6769 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:35:51.642524 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:51.644176 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:35:51.659026 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf65259-3726-4e76-b331-0ea63bc82b12 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:51.701009 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:51.721863 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:51.722508 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:51.722787 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:51.723059 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] PATH_INFO: `/v3/users/30373d71948d4326af88e6f93ff4d3c7` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:51.724253 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30373d71948d4326af88e6f93ff4d3c7)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:51.726306 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:51.883443 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30373d71948d4326af88e6f93ff4d3c7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.890415 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30373d71948d4326af88e6f93ff4d3c7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.943100 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30373d71948d4326af88e6f93ff4d3c7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.956483 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30373d71948d4326af88e6f93ff4d3c7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.957174 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30373d71948d4326af88e6f93ff4d3c7'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:51.963438 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1450/2901] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:35:51 2022] DELETE /identity/v3/users/30373d71948d4326af88e6f93ff4d3c7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:35:52.174143 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:35:52.175661 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:35:52.191157 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b9bd-09f0-4859-a83a-06fd834ad99e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:35:52.241956 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:35:52.249202 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:35:52.249830 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:35:52.250111 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:35:52.250412 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] PATH_INFO: `/v3/projects/a53a5bc2bec94bd6b492db515fd0c331` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:35:52.251573 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53a5bc2bec94bd6b492db515fd0c331)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:35:52.253539 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:35:52.343371 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53a5bc2bec94bd6b492db515fd0c331', 'request_id': 'req-2c973485-371b-4f56-a787-f09fbc4ee83e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:52.348796 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53a5bc2bec94bd6b492db515fd0c331', 'request_id': 'req-2c973485-371b-4f56-a787-f09fbc4ee83e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:52.423052 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53a5bc2bec94bd6b492db515fd0c331', 'request_id': 'req-2c973485-371b-4f56-a787-f09fbc4ee83e'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:52.435787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] The token cache is being invalidate because project a53a5bc2bec94bd6b492db515fd0c331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:35:52.435787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:52.437907 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:35:52.438651 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1452/2902] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:35:52 2022] DELETE /identity/v3/projects/a53a5bc2bec94bd6b492db515fd0c331 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:36:01.959727 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:36:02.432208 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:36:40.606370 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:36:40.608394 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:36:40.698442 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0daafa-91b1-4409-a539-6e6054493c4a admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:36:40.764200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a82e8f2e304418adce1935fe7abcb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:36:40.764869 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:36:40.765316 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:36:40.765661 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:36:40.767487 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:36:40.781121 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:36:40.782721 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:36:40.794680 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1451/2903] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:36:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:36:49.435435 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:36:49.439971 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:36:49.509693 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973485-371b-4f56-a787-f09fbc4ee83e admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:36:49.514749 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:36:49.515392 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] REQUEST_METHOD: `GET` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:36:49.515689 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:36:49.515938 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:36:49.518074 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:36:49.530337 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:36:49.532290 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:36:49.542856 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1453/2904] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:36:50.789552 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=62 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:36:53.224433 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:36:53.226943 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:36:53.294091 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc6822-aad5-44df-9b5a-ff2f39803371 service nova] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:36:53.298679 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:36:53.299366 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:36:53.299645 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:36:53.299918 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] PATH_INFO: `/v3/users/9c131d1e0c684d9eb83b388c2946bb0f` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:36:53.301118 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c131d1e0c684d9eb83b388c2946bb0f)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:36:53.303038 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:36:53.507302 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c131d1e0c684d9eb83b388c2946bb0f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:53.514294 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c131d1e0c684d9eb83b388c2946bb0f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:53.617681 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c131d1e0c684d9eb83b388c2946bb0f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:53.630222 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c131d1e0c684d9eb83b388c2946bb0f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:53.630867 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c131d1e0c684d9eb83b388c2946bb0f'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:53.636953 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1452/2905] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:36:53 2022] DELETE /identity/v3/users/9c131d1e0c684d9eb83b388c2946bb0f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:36:53.893597 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:36:53.905587 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb983b55-99d5-4ed7-a456-dac4c46055a0 service placement] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:36:53.966555 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:36:53.967197 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:36:53.967478 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:36:53.967754 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] PATH_INFO: `/v3/projects/6d653a494a3d4fb693a58c000750ba2c` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:36:53.968944 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d653a494a3d4fb693a58c000750ba2c)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:36:53.970918 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:36:54.104336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d653a494a3d4fb693a58c000750ba2c', 'request_id': 'req-5b3c538b-a594-4d53-a882-12e792260601'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.110487 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d653a494a3d4fb693a58c000750ba2c', 'request_id': 'req-5b3c538b-a594-4d53-a882-12e792260601'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.188367 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d653a494a3d4fb693a58c000750ba2c', 'request_id': 'req-5b3c538b-a594-4d53-a882-12e792260601'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.202399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] The token cache is being invalidate because project 6d653a494a3d4fb693a58c000750ba2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:36:54.204399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.204399 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.204799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1454/2906] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:36:53 2022] DELETE /identity/v3/projects/6d653a494a3d4fb693a58c000750ba2c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:36:54.210692 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:36:54.212098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:36:54.227898 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edff4-b8d8-4cd2-b8dd-2d2bb914bc0d admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:36:54.291534 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:36:54.292189 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:36:54.292471 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:36:54.292744 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] PATH_INFO: `/v3/users/2d866ea12e164881a4bc5d7c7b73828c` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:36:54.294319 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d866ea12e164881a4bc5d7c7b73828c)` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:36:54.296516 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:36:54.323349 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:36:54.500345 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d866ea12e164881a4bc5d7c7b73828c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.507929 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d866ea12e164881a4bc5d7c7b73828c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.582668 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d866ea12e164881a4bc5d7c7b73828c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.598993 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d866ea12e164881a4bc5d7c7b73828c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.600098 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.notifications [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d866ea12e164881a4bc5d7c7b73828c'} {{(pid=80841) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:54.608704 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1453/2907] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 21:36:54 2022] DELETE /identity/v3/users/2d866ea12e164881a4bc5d7c7b73828c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:36:54.855463 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] Authenticating user token {{(pid=80840) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:36:54.860359 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.fernet_utils [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80840) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:36:54.875114 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c538b-a594-4d53-a882-12e792260601 admin admin] Validating token access rules against request {{(pid=80840) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:36:54.893960 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:36:54.935730 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3130018efa44a5a2048fca15b5c1f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec42bd454d34bf891854ee5fd76a3ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80840) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:36:54.936370 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:36:54.936650 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:36:54.936953 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] PATH_INFO: `/v3/projects/e8dc893a3ca149049f25bde29b65915c` {{(pid=80840) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:36:54.938113 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8dc893a3ca149049f25bde29b65915c)` {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:36:54.940011 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] RBAC: Authorization granted {{(pid=80840) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:36:55.079787 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8dc893a3ca149049f25bde29b65915c', 'request_id': 'req-1f0fecb1-ac9d-41c7-896f-87ed474d2306'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:55.085648 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8dc893a3ca149049f25bde29b65915c', 'request_id': 'req-1f0fecb1-ac9d-41c7-896f-87ed474d2306'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:55.159674 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8dc893a3ca149049f25bde29b65915c', 'request_id': 'req-1f0fecb1-ac9d-41c7-896f-87ed474d2306'} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:55.171799 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] The token cache is being invalidate because project e8dc893a3ca149049f25bde29b65915c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80840) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:36:55.174077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:55.174077 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG keystone.notifications [None req-1f0fecb1-ac9d-41c7-896f-87ed474d2306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80840) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:36:55.174336 dv-cinder-852209-1-smb devstack@keystone.service[80840]: [pid: 80840|app: 0|req: 1455/2908] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 21:36:54 2022] DELETE /identity/v3/projects/e8dc893a3ca149049f25bde29b65915c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:37:04.604299 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:37:05.168945 dv-cinder-852209-1-smb devstack@keystone.service[80840]: DEBUG dbcounter [-] [80840] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:38:39.388099 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] Authenticating user token {{(pid=80841) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:38:39.389529 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:38:39.458479 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac39e1b-485b-45cc-8c9b-32cba34a4735 admin admin] Validating token access rules against request {{(pid=80841) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:38:39.517266 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba06aec-a69e-45cc-b47a-62970f7eb930 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afab8bad046e462b9bd6188fa01720d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2b2ffb95af54340bb23ab0e10a7351b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80841) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:38:39.517889 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06aec-a69e-45cc-b47a-62970f7eb930 service placement] REQUEST_METHOD: `GET` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:38:39.518169 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06aec-a69e-45cc-b47a-62970f7eb930 service placement] SCRIPT_NAME: `/identity` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:38:39.518441 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06aec-a69e-45cc-b47a-62970f7eb930 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80841) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:38:39.520200 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.fernet_utils [None req-3ba06aec-a69e-45cc-b47a-62970f7eb930 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80841) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:38:39.531444 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba06aec-a69e-45cc-b47a-62970f7eb930 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:38:39.533054 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba06aec-a69e-45cc-b47a-62970f7eb930 service placement] RBAC: Authorization granted {{(pid=80841) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:38:39.543231 dv-cinder-852209-1-smb devstack@keystone.service[80841]: [pid: 80841|app: 0|req: 1454/2909] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Aug 4 21:38:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:38:49.538558 dv-cinder-852209-1-smb devstack@keystone.service[80841]: DEBUG dbcounter [-] [80841] Writing DB stats keystone:SELECT=58 {{(pid=80841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}